Text Generation
GGUF
English
Māori
llama.cpp
abteex-ai-labs
aotearoa
coder
coding
local-first
lumynax
Mixture of Experts
new-zealand
sovereign-ai
imatrix
conversational
Instructions to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="AbteeXAILab/lumynax-coder-starcoder2-15b-gguf", filename="starcoder2-15b-instruct-v0.1-Q4_K_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M # Run inference directly in the terminal: llama-cli -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M # Run inference directly in the terminal: llama-cli -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
Use Docker
docker model run hf.co/AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AbteeXAILab/lumynax-coder-starcoder2-15b-gguf" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AbteeXAILab/lumynax-coder-starcoder2-15b-gguf", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
- Ollama
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with Ollama:
ollama run hf.co/AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
- Unsloth Studio
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for AbteeXAILab/lumynax-coder-starcoder2-15b-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for AbteeXAILab/lumynax-coder-starcoder2-15b-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for AbteeXAILab/lumynax-coder-starcoder2-15b-gguf to start chatting
- Docker Model Runner
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with Docker Model Runner:
docker model run hf.co/AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
- Lemonade
How to use AbteeXAILab/lumynax-coder-starcoder2-15b-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull AbteeXAILab/lumynax-coder-starcoder2-15b-gguf:Q4_K_M
Run and chat with the model
lemonade run user.lumynax-coder-starcoder2-15b-gguf-Q4_K_M
List all available models
lemonade list
feat: initial LumynaX scaffold (card v6 + quickstart + manifest + Modelfile + Space scaffold)
Browse files- LICENSE.txt +15 -0
- README.md +330 -0
- UPLOAD_TO_HF.md +14 -0
- VERSION.txt +1 -0
- checksums.sha256 +6 -0
- docs/lumynax-capability.svg +12 -0
- docs/lumynax-overview.svg +24 -0
- docs/lumynax-runtime-flow.svg +21 -0
- hf_space/README.md +22 -0
- hf_space/app.py +27 -0
- hf_space/requirements.txt +1 -0
- ollama/Modelfile +7 -0
- quickstart.py +64 -0
- release_export_manifest.json +35 -0
- requirements.txt +3 -0
LICENSE.txt
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
LumynaX release package — distribution scaffold
|
| 2 |
+
|
| 3 |
+
This Hugging Face repository contains the LumynaX release scaffold for the
|
| 4 |
+
upstream model identified in `release_export_manifest.json`. The model weights
|
| 5 |
+
themselves remain governed by the upstream licence at `metadata.upstream_repo`
|
| 6 |
+
and are fetched by the runtime via Hugging Face Hub when you execute
|
| 7 |
+
`quickstart.py`.
|
| 8 |
+
|
| 9 |
+
The scaffold (configs, manifest, quickstart, ollama Modelfile, Space app) is
|
| 10 |
+
released under the MIT licence by AbteeX AI Labs (Aotearoa New Zealand). Your
|
| 11 |
+
use of the *upstream weights* is governed by the *upstream licence*; this file
|
| 12 |
+
does not relicense them.
|
| 13 |
+
|
| 14 |
+
Provenance, residency and audit obligations are defined in
|
| 15 |
+
`release_export_manifest.json` and the model card.
|
README.md
ADDED
|
@@ -0,0 +1,330 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: llama.cpp
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
+
language:
|
| 6 |
+
- en
|
| 7 |
+
- mi
|
| 8 |
+
tags:
|
| 9 |
+
- abteex-ai-labs
|
| 10 |
+
- aotearoa
|
| 11 |
+
- coder
|
| 12 |
+
- coding
|
| 13 |
+
- gguf
|
| 14 |
+
- local-first
|
| 15 |
+
- lumynax
|
| 16 |
+
- moe
|
| 17 |
+
- new-zealand
|
| 18 |
+
- sovereign-ai
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
+
<p align="center"><img src="docs/lumynax-overview.svg" alt="LumynaX Coder StarCoder2 15B Instruct GGUF release overview" width="100%" /></p>
|
| 22 |
+
|
| 23 |
+
<!-- lumynax-public-release-card:v6 -->
|
| 24 |
+
|
| 25 |
+
<h1 align="center">LumynaX Coder StarCoder2 15B Instruct GGUF</h1>
|
| 26 |
+
|
| 27 |
+
<p align="center"><em>“Sovereign intelligence, held in the light.”</em><br/><em>Ko te mārama te tūāpapa — the light is the foundation.</em></p>
|
| 28 |
+
|
| 29 |
+
<p align="center"><strong>A LumynaX release from AbteeX AI Labs — Aotearoa New Zealand.</strong></p>
|
| 30 |
+
|
| 31 |
+
<p align="center">
|
| 32 |
+
<a href="#-quickstart"><b>Quickstart</b></a> ·
|
| 33 |
+
<a href="#-runtime-architecture"><b>Architecture</b></a> ·
|
| 34 |
+
<a href="#-model-profile"><b>Profile</b></a> ·
|
| 35 |
+
<a href="#-capability-profile"><b>Capability</b></a> ·
|
| 36 |
+
<a href="#-provenance--license"><b>Provenance</b></a> ·
|
| 37 |
+
<a href="#-validation"><b>Validation</b></a> ·
|
| 38 |
+
<a href="#-companion-products"><b>Companions</b></a>
|
| 39 |
+
</p>
|
| 40 |
+
|
| 41 |
+
<p align="center"><img alt="LumynaX: release" src="https://img.shields.io/badge/LumynaX-release-e08a2c?style=for-the-badge" /> <img alt="Family: starcoder2" src="https://img.shields.io/badge/Family-starcoder2-9a5416?style=for-the-badge" /> <img alt="Runtime: llama%20cpp" src="https://img.shields.io/badge/Runtime-llama%20cpp-726b62?style=for-the-badge" /> <img alt="Modes: text" src="https://img.shields.io/badge/Modes-text-4d6b44?style=for-the-badge" /> <img alt="Params: 15B" src="https://img.shields.io/badge/Params-15B-0a0a0b?style=for-the-badge" /> <img alt="Quant: Q4_K_M GGUF" src="https://img.shields.io/badge/Quant-Q4__K__M%20GGUF-111827?style=for-the-badge" /> <img alt="Context: 16384%20tok" src="https://img.shields.io/badge/Context-16384%20tok-111827?style=for-the-badge" /> <img alt="License: apache-2.0" src="https://img.shields.io/badge/License-apache--2.0-9a5416?style=for-the-badge" /> <img alt="Sovereignty: tier%203" src="https://img.shields.io/badge/Sovereignty-tier%203-4d6b44?style=for-the-badge" /> <img alt="Audit: pass" src="https://img.shields.io/badge/Audit-pass-4d6b44?style=for-the-badge" /> <img alt="Access: public%20&%20non--gated" src="https://img.shields.io/badge/Access-public%20&%20non----gated-0a0a0b?style=for-the-badge" /> <img alt="Card: v6" src="https://img.shields.io/badge/Card-v6-111827?style=for-the-badge" /></p>
|
| 42 |
+
|
| 43 |
+
<p align="center"><kbd>Quality: <b>4/5</b></kbd> · <kbd>Lightweight: <b>3/5</b></kbd> · <kbd>Sovereignty: <b>3/5</b></kbd> · <kbd>Tools: <b>yes</b></kbd> · <kbd>JSON: <b>yes</b></kbd> · <kbd>Context: <b>16384 tok</b></kbd></p>
|
| 44 |
+
|
| 45 |
+
---
|
| 46 |
+
|
| 47 |
+
## 📦 Executive Summary
|
| 48 |
+
|
| 49 |
+
> `AbteeXAILab/lumynax-coder-starcoder2-15b-gguf` is a **complete LumynaX release package**: model artifact, `quickstart.py`, `requirements.txt`, `release_export_manifest.json`, `checksums.sha256`, license notice, and optional Ollama / Space scaffolds shipped as **one downloadable contract**. Clone whole, verify by checksum, and run close to the data it serves.
|
| 50 |
+
|
| 51 |
+
> **LumynaX-infused** means the upstream artifact is presented through the LumynaX release layer: local-first runtime scaffolding, LumynaX assistant identity, inference-chain metadata, integrity files, and Aotearoa New Zealand-oriented workflow positioning. The release manifest records this as a LumynaX *packaging and inference-chain layer* around the listed upstream artifact — it does **not** claim a private LumynaX weight merge.
|
| 52 |
+
|
| 53 |
+
## 🧭 Runtime Architecture
|
| 54 |
+
|
| 55 |
+
<p align="center"><img src="docs/lumynax-runtime-flow.svg" alt="LumynaX runtime flow" width="100%" /></p>
|
| 56 |
+
|
| 57 |
+
Mermaid graph (interactive on Hugging Face & GitHub):
|
| 58 |
+
|
| 59 |
+
```mermaid
|
| 60 |
+
flowchart LR
|
| 61 |
+
R["⮕ Request"] --> C["🛡 Data Capsule<br/>policy envelope"]
|
| 62 |
+
C -->|allow| MR["🧭 MaramaRoute<br/>sovereign router"]
|
| 63 |
+
MR -->|score & select| LLM[(LumynaX Model)]
|
| 64 |
+
LLM --> O["📤 Response"]
|
| 65 |
+
O --> A["📓 Audit Ledger<br/>hash-chained"]
|
| 66 |
+
classDef paper fill:#fffefa,stroke:#0a0a0b,color:#0a0a0b,stroke-width:1.4px;
|
| 67 |
+
classDef accent fill:#e08a2c,stroke:#9a5416,color:#0a0a0b,stroke-width:1.4px;
|
| 68 |
+
classDef ink fill:#0a0a0b,stroke:#0a0a0b,color:#fffefa,stroke-width:1.4px;
|
| 69 |
+
class R,O paper
|
| 70 |
+
class C,MR accent
|
| 71 |
+
class LLM,EMB,A ink
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
Each step is observable:
|
| 75 |
+
|
| 76 |
+
| Step | What happens | Why |
|
| 77 |
+
| --- | --- | --- |
|
| 78 |
+
| **Request** | A client sends a prompt + declared purpose, jurisdiction, sensitivity. | Intent must be declared, not inferred. |
|
| 79 |
+
| **Data Capsule** | A policy envelope describes what can / cannot happen to the data. | Sovereignty is enforced at the data, not the wire. |
|
| 80 |
+
| **MaramaRoute** | The sovereign router scores candidates by jurisdiction, runtime, modality, task fit. | Right model for the work, not the loudest. |
|
| 81 |
+
| **LumynaX Model** | This package serves the inference, local-first by default. | Sensitive context never leaves the operator’s environment. |
|
| 82 |
+
| **Audit Ledger** | A hash-chained record persists capsule, decision, request hash, obligations. | Tamper-evident provenance for the whole trace. |
|
| 83 |
+
|
| 84 |
+
## ⚡ Quickstart
|
| 85 |
+
|
| 86 |
+
**Clone the whole release** — every file matters, the package is a contract:
|
| 87 |
+
|
| 88 |
+
```bash
|
| 89 |
+
hf download AbteeXAILab/lumynax-coder-starcoder2-15b-gguf --local-dir lumynax-coder-starcoder2-15b-gguf
|
| 90 |
+
cd lumynax-coder-starcoder2-15b-gguf
|
| 91 |
+
pip install -r requirements.txt
|
| 92 |
+
python quickstart.py --interactive
|
| 93 |
+
```
|
| 94 |
+
|
| 95 |
+
**Python:**
|
| 96 |
+
|
| 97 |
+
```python
|
| 98 |
+
from llama_cpp import Llama
|
| 99 |
+
|
| 100 |
+
llm = Llama(model_path="starcoder2-15b-instruct-v0.1-Q4_K_M.gguf", n_ctx=16384, n_threads=8, verbose=False)
|
| 101 |
+
out = llm("Who are you? Answer as LumynaX in two sentences.", max_tokens=160)
|
| 102 |
+
print(out["choices"][0]["text"].strip())
|
| 103 |
+
```
|
| 104 |
+
|
| 105 |
+
**CLI smoke test:**
|
| 106 |
+
|
| 107 |
+
```bash
|
| 108 |
+
llama-cli -m "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf" -p "Who are you? Answer as LumynaX in two sentences." -n 160
|
| 109 |
+
```
|
| 110 |
+
|
| 111 |
+
**Ollama path:**
|
| 112 |
+
|
| 113 |
+
```bash
|
| 114 |
+
ollama create lumynax-coder-starcoder2-15b-gguf -f ollama/Modelfile
|
| 115 |
+
ollama run lumynax-coder-starcoder2-15b-gguf
|
| 116 |
+
```
|
| 117 |
+
|
| 118 |
+
**Verify integrity before launch:**
|
| 119 |
+
|
| 120 |
+
```bash
|
| 121 |
+
sha256sum "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf"
|
| 122 |
+
cat checksums.sha256
|
| 123 |
+
```
|
| 124 |
+
|
| 125 |
+
```powershell
|
| 126 |
+
Get-FileHash -Algorithm SHA256 "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf"
|
| 127 |
+
Get-Content checksums.sha256
|
| 128 |
+
```
|
| 129 |
+
|
| 130 |
+
## 📐 Model Profile
|
| 131 |
+
|
| 132 |
+
<table>
|
| 133 |
+
<tr><td>
|
| 134 |
+
|
| 135 |
+
**Release identity**
|
| 136 |
+
|
| 137 |
+
| Field | Value |
|
| 138 |
+
| --- | --- |
|
| 139 |
+
| Release | `LumynaX Coder StarCoder2 15B Instruct GGUF` |
|
| 140 |
+
| Repository | `AbteeXAILab/lumynax-coder-starcoder2-15b-gguf` |
|
| 141 |
+
| Family | `starcoder2` |
|
| 142 |
+
| Mode | `Local-first coding assistant package` |
|
| 143 |
+
| Card schema | `lumynax-public-release-card:v6` |
|
| 144 |
+
|
| 145 |
+
</td><td>
|
| 146 |
+
|
| 147 |
+
**Runtime profile**
|
| 148 |
+
|
| 149 |
+
| Field | Value |
|
| 150 |
+
| --- | --- |
|
| 151 |
+
| Runtime | `llama_cpp` |
|
| 152 |
+
| Prompt format | `chatml` |
|
| 153 |
+
| Modalities | `text` |
|
| 154 |
+
| Context window | `16384` tokens |
|
| 155 |
+
| Quantization | `Q4_K_M GGUF` |
|
| 156 |
+
|
| 157 |
+
</td></tr>
|
| 158 |
+
<tr><td>
|
| 159 |
+
|
| 160 |
+
**Artifact**
|
| 161 |
+
|
| 162 |
+
| Field | Value |
|
| 163 |
+
| --- | --- |
|
| 164 |
+
| Primary | `starcoder2-15b-instruct-v0.1-Q4_K_M.gguf` |
|
| 165 |
+
| Weight size | `—` |
|
| 166 |
+
| Parameters | `15B` |
|
| 167 |
+
| Quality rank | `2` (1 best) |
|
| 168 |
+
| Cost rank | `3` (1 cheapest) |
|
| 169 |
+
|
| 170 |
+
</td><td>
|
| 171 |
+
|
| 172 |
+
**Provenance**
|
| 173 |
+
|
| 174 |
+
| Field | Value |
|
| 175 |
+
| --- | --- |
|
| 176 |
+
| Upstream / base | `bigcode/starcoder2-15b-instruct-v0.1` |
|
| 177 |
+
| Source | `bigcode/starcoder2-15b-instruct-v0.1` |
|
| 178 |
+
| License | `apache-2.0` |
|
| 179 |
+
| Sovereignty tier | `3` of 5 |
|
| 180 |
+
| Audit | `pass` |
|
| 181 |
+
|
| 182 |
+
</td></tr>
|
| 183 |
+
</table>
|
| 184 |
+
|
| 185 |
+
## 📊 Capability Profile
|
| 186 |
+
|
| 187 |
+
<p align="center"><img src="docs/lumynax-capability.svg" alt="Capability profile bars" width="100%" /></p>
|
| 188 |
+
|
| 189 |
+
> **Primary fit.** Code review, refactor drafts, test generation, and explanations near governed source.
|
| 190 |
+
|
| 191 |
+
| Signal | Reading |
|
| 192 |
+
| --- | --- |
|
| 193 |
+
| Quality rank | `2` (1 = strongest in family) |
|
| 194 |
+
| Cost rank | `3` (1 = lightest weight) |
|
| 195 |
+
| Sovereignty tier | `3` of 5 |
|
| 196 |
+
| Tool calling | ✅ supported |
|
| 197 |
+
| JSON mode | ✅ supported |
|
| 198 |
+
| Identity behaviour | Identifies as LumynaX while keeping upstream provenance visible. |
|
| 199 |
+
| Operational style | Local-first package with explicit files, checksums, and reproducible quickstarts. |
|
| 200 |
+
|
| 201 |
+
## 🛡️ Sovereignty Contract
|
| 202 |
+
|
| 203 |
+
> **Sovereignty is a design property, not a deployment option.**
|
| 204 |
+
|
| 205 |
+
| Field | Value |
|
| 206 |
+
| --- | --- |
|
| 207 |
+
| Publisher | AbteeX AI Labs |
|
| 208 |
+
| Family | LumynaX sovereign release family |
|
| 209 |
+
| Sovereign intent | Local-first deployment near governed data, with explicit provenance and controlled human review. |
|
| 210 |
+
| Sovereignty tier | `3` of 5 |
|
| 211 |
+
| Runtime residency | `llama_cpp` can be deployed inside an operator-approved environment. |
|
| 212 |
+
| Primary artifact | `starcoder2-15b-instruct-v0.1-Q4_K_M.gguf` — ships alongside manifest, checksums, quickstart, requirements, and license files. |
|
| 213 |
+
| License discipline | Surface upstream license metadata so downstream users can verify redistribution and usage terms. |
|
| 214 |
+
| Audit expectation | Record repo id, artifact checksum, runtime command, prompt template, operator, deployment environment. |
|
| 215 |
+
| Router readiness | First-class with [LumynaX MaramaRoute](https://huggingface.co/AbteeXAILab/marama-route). |
|
| 216 |
+
| Policy readiness | First-class with [AbteeX SovereignCode](https://huggingface.co/AbteeXAILab/sovereigncode). |
|
| 217 |
+
|
| 218 |
+
## 📁 Runtime Files
|
| 219 |
+
|
| 220 |
+
```text
|
| 221 |
+
lumynax-coder-starcoder2-15b-gguf/
|
| 222 |
+
├── README.md # this card
|
| 223 |
+
├── quickstart.py # smoke runner
|
| 224 |
+
├── requirements.txt # pinned deps
|
| 225 |
+
├── release_export_manifest.json # full release metadata
|
| 226 |
+
├── checksums.sha256 # integrity verification
|
| 227 |
+
├── LICENSE.txt # license notice
|
| 228 |
+
├── ollama/Modelfile # optional Ollama runtime
|
| 229 |
+
├── hf_space/app.py # optional Space scaffold
|
| 230 |
+
├── docs/lumynax-overview.svg # release banner
|
| 231 |
+
├── docs/lumynax-runtime-flow.svg # runtime architecture
|
| 232 |
+
├── docs/lumynax-capability.svg # capability profile
|
| 233 |
+
└── starcoder2-15b-instruct-v0.1-Q4_K_M.gguf# primary artifact
|
| 234 |
+
```
|
| 235 |
+
|
| 236 |
+
⚠️ **Keep the full set together.** Removing the manifest, checksums, or license file breaks the release contract.
|
| 237 |
+
|
| 238 |
+
## 💬 Prompting Contract
|
| 239 |
+
|
| 240 |
+
**Preferred opening prompt:**
|
| 241 |
+
|
| 242 |
+
```text
|
| 243 |
+
Who are you? What files do I need to keep together to run this package locally?
|
| 244 |
+
```
|
| 245 |
+
|
| 246 |
+
> **Expected behaviour.** The assistant identifies as LumynaX, explains that this is a LumynaX model-infusion release, and keeps upstream provenance visible.
|
| 247 |
+
|
| 248 |
+
**Default system prompt:**
|
| 249 |
+
|
| 250 |
+
```text
|
| 251 |
+
You are LumynaX operating from the LumynaX Coder StarCoder2 15B Instruct GGUF package identity. Be helpful, clear, and honest about provenance. Identify upstream models when asked. Do not invent biographical claims about named people without verified context.
|
| 252 |
+
```
|
| 253 |
+
|
| 254 |
+
## ✅ Validation
|
| 255 |
+
|
| 256 |
+
| Check | Result |
|
| 257 |
+
| --- | --- |
|
| 258 |
+
| Runtime audit | ✅ `pass` |
|
| 259 |
+
| Public access | ✅ `public and non-gated` |
|
| 260 |
+
| Anonymous metadata access | ✅ `true` |
|
| 261 |
+
| Anonymous file listing | ✅ `true` |
|
| 262 |
+
| Quickstart syntax | ✅ `pass` |
|
| 263 |
+
| Manifest references | ✅ `pass` |
|
| 264 |
+
| Checksum references | ✅ `pass` |
|
| 265 |
+
|
| 266 |
+
> The audit confirms public access, release files, manifest references, checksum references, weight artifact presence, and quickstart syntax. It does **not** guarantee that every laptop has enough RAM, VRAM, disk, or recent runtime build for the largest packages.
|
| 267 |
+
|
| 268 |
+
## 🔗 Provenance & License
|
| 269 |
+
|
| 270 |
+
| Field | Value |
|
| 271 |
+
| --- | --- |
|
| 272 |
+
| **Publisher** | AbteeX AI Labs |
|
| 273 |
+
| **Family** | LumynaX model and inference-chain release family |
|
| 274 |
+
| **Upstream / base** | `bigcode/starcoder2-15b-instruct-v0.1` |
|
| 275 |
+
| **Source** | `bigcode/starcoder2-15b-instruct-v0.1` |
|
| 276 |
+
| **License metadata** | `apache-2.0` |
|
| 277 |
+
|
| 278 |
+
> **Respect the upstream model licence** and keep attribution files with redistributed copies. Do not present this package as privately trained or weight-merged unless the release manifest explicitly says weight adaptation was applied.
|
| 279 |
+
|
| 280 |
+
## ⚠️ Limitations & Responsible Use
|
| 281 |
+
|
| 282 |
+
- Outputs can be **incorrect, incomplete, or biased**; validate important answers before use.
|
| 283 |
+
- Larger GGUF, MoE, multimodal, and frontier packages may require **substantial RAM, VRAM, disk space, and recent runtime builds**.
|
| 284 |
+
- For high-impact decisions, use **human review** and domain-specific evaluation.
|
| 285 |
+
- For sensitive data, prefer **local execution** and keep operational logs under your own governance policy.
|
| 286 |
+
- This card documents **package readiness and access** — it is *not* a benchmark claim.
|
| 287 |
+
- The assistant must **not invent biographical or organisational claims** about named people without verified context.
|
| 288 |
+
|
| 289 |
+
## 🌿 Aotearoa Kaupapa
|
| 290 |
+
|
| 291 |
+
> LumynaX is built **in and for Aotearoa New Zealand**. Sovereignty is treated as a design property rather than a deployment option: the package documents where the model came from, what it can do, how to run it close to your data, and what it should not claim.
|
| 292 |
+
|
| 293 |
+
> *Ko te mārama te tūāpapa* — the light is the foundation.
|
| 294 |
+
|
| 295 |
+
## 🤝 Companion Products
|
| 296 |
+
|
| 297 |
+
<table>
|
| 298 |
+
<tr>
|
| 299 |
+
<td width="33%" align="center"><h3>🛡️</h3><h4><a href="https://huggingface.co/AbteeXAILab/sovereigncode">AbteeX SovereignCode</a></h4><p>Local-first coding agent with Data Capsule policy controls, audit ledger, and human-review gates.</p></td>
|
| 300 |
+
<td width="33%" align="center"><h3>🧭</h3><h4><a href="https://huggingface.co/AbteeXAILab/marama-route">LumynaX MaramaRoute</a></h4><p>Sovereign model router across the LumynaX family. Filters by jurisdiction, residency, license, runtime, modality.</p></td>
|
| 301 |
+
<td width="33%" align="center"><h3>💡</h3><h4><a href="https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo">LumynaX Live Demo</a></h4><p>Public browser demo. Try identity, provenance, governance, and deployment prompts in one session.</p></td>
|
| 302 |
+
</tr>
|
| 303 |
+
<tr>
|
| 304 |
+
<td width="33%" align="center"><h4><a href="https://huggingface.co/spaces/AbteeXAILab/sovereigncode-demo">SovereignCode Live</a></h4><p>Interactive policy evaluator.</p></td>
|
| 305 |
+
<td width="33%" align="center"><h4><a href="https://huggingface.co/spaces/AbteeXAILab/marama-route-demo">MaramaRoute Live</a></h4><p>Interactive sovereign router.</p></td>
|
| 306 |
+
<td width="33%" align="center"><h4><a href="https://huggingface.co/AbteeXAILab">AbteeXAILab on HF</a></h4><p>The full LumynaX release family — 50 models and counting.</p></td>
|
| 307 |
+
</tr>
|
| 308 |
+
</table>
|
| 309 |
+
|
| 310 |
+
## 🤖 Automation Notes
|
| 311 |
+
|
| 312 |
+
Automation should read these files before launching:
|
| 313 |
+
|
| 314 |
+
- `release_export_manifest.json`
|
| 315 |
+
- `checksums.sha256`
|
| 316 |
+
- `quickstart.py`
|
| 317 |
+
- `requirements.txt`
|
| 318 |
+
- `ollama/Modelfile` when present
|
| 319 |
+
|
| 320 |
+
---
|
| 321 |
+
|
| 322 |
+
<p align="center"><em><b>Local roots, global work.</b> · <b>Sovereignty is a design property, not a deployment option.</b></em></p>
|
| 323 |
+
|
| 324 |
+
<p align="center">
|
| 325 |
+
<a href="https://abteex.com"><b>abteex.com</b></a> ·
|
| 326 |
+
<a href="https://lumynax.com"><b>lumynax.com</b></a> ·
|
| 327 |
+
<a href="https://huggingface.co/AbteeXAILab"><b>huggingface.co/AbteeXAILab</b></a>
|
| 328 |
+
</p>
|
| 329 |
+
|
| 330 |
+
<p align="center"><sub>AbteeX AI Labs · Aotearoa New Zealand · LumynaX release card v6</sub></p>
|
UPLOAD_TO_HF.md
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Upload checklist (AbteeX AI Labs)
|
| 2 |
+
|
| 3 |
+
This scaffold was generated and pushed by `S:\hf-publish\add_8_more_models.py`.
|
| 4 |
+
The repo is structured to be cloned whole and verified locally before running.
|
| 5 |
+
|
| 6 |
+
```bash
|
| 7 |
+
hf download AbteeXAILab/lumynax-coder-starcoder2-15b-gguf --local-dir lumynax-coder-starcoder2-15b-gguf
|
| 8 |
+
cd lumynax-coder-starcoder2-15b-gguf
|
| 9 |
+
pip install -r requirements.txt
|
| 10 |
+
python quickstart.py --interactive
|
| 11 |
+
```
|
| 12 |
+
|
| 13 |
+
To regenerate or refresh, re-run the script — `huggingface_hub.HfApi.upload_folder`
|
| 14 |
+
is idempotent.
|
VERSION.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
v0.1.0
|
checksums.sha256
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
601956b52f7e59484c150ec4b1e9b1186adc331bf92c4a7127834ba2ff70a968 LICENSE.txt
|
| 2 |
+
d0b4f9120ba026c00fa23cb84b4e1620a2e6436592e58155a5151653179572c0 VERSION.txt
|
| 3 |
+
b2d3748d2d461705793fbdc2d1fc9721cb2b4efa27991bedddcd868d626c1c58 ollama/Modelfile
|
| 4 |
+
f39bfab9576d763a9c14e031312eb37787cf1119e392bbf096b9654c90e9d89e quickstart.py
|
| 5 |
+
c231ed8b090e8894c51ee6010bae9dc5f2b4b55b5fb361a5f32c5df4bc1135e1 release_export_manifest.json
|
| 6 |
+
44fc2c3474d1cc9ef66f42dfc3fcc4aa571eae4bf7720fae3569a7451f7e4a3f requirements.txt
|
docs/lumynax-capability.svg
ADDED
|
|
docs/lumynax-overview.svg
ADDED
|
|
docs/lumynax-runtime-flow.svg
ADDED
|
|
hf_space/README.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: LumynaX Coder StarCoder2 15B Instruct GGUF
|
| 3 |
+
colorFrom: yellow
|
| 4 |
+
colorTo: gray
|
| 5 |
+
sdk: gradio
|
| 6 |
+
sdk_version: 5.50.0
|
| 7 |
+
python_version: 3.11
|
| 8 |
+
app_file: app.py
|
| 9 |
+
pinned: false
|
| 10 |
+
license: apache-2.0
|
| 11 |
+
short_description: Scaffold Space for the lumynax-coder-starcoder2-15b-gguf LumynaX release.
|
| 12 |
+
tags:
|
| 13 |
+
- abteex-ai-labs
|
| 14 |
+
- lumynax
|
| 15 |
+
- sovereign-ai
|
| 16 |
+
- new-zealand
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
# LumynaX Coder StarCoder2 15B Instruct GGUF
|
| 20 |
+
|
| 21 |
+
Scaffold Space for `AbteeXAILab/lumynax-coder-starcoder2-15b-gguf`. The actual model weights are too large to host on a free Space.
|
| 22 |
+
Clone the package repo and run `quickstart.py` locally for the real inference path.
|
hf_space/app.py
ADDED
|
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
import os
|
| 2 |
+
import gradio as gr
|
| 3 |
+
|
| 4 |
+
REPO_ID = "AbteeXAILab/lumynax-coder-starcoder2-15b-gguf"
|
| 5 |
+
UPSTREAM = "bigcode/starcoder2-15b-instruct-v0.1"
|
| 6 |
+
TITLE = "LumynaX Coder StarCoder2 15B Instruct GGUF"
|
| 7 |
+
|
| 8 |
+
THEME_CSS = """
|
| 9 |
+
:root { --lx-paper:#fffefa; --lx-ink:#0a0a0b; --lx-amber:#e08a2c; }
|
| 10 |
+
body, .gradio-container { background: var(--lx-paper) !important; color: var(--lx-ink) !important; }
|
| 11 |
+
h1, h2, h3 { font-family: 'Cormorant Garamond', 'EB Garamond', Georgia, serif; }
|
| 12 |
+
"""
|
| 13 |
+
|
| 14 |
+
def chat_stub(message, history):
|
| 15 |
+
return (
|
| 16 |
+
f"This Space is a scaffold for **{TITLE}**. The upstream model is `{UPSTREAM}` "
|
| 17 |
+
f"and the LumynaX package repo is `{REPO_ID}`. Cloud inference for >100B MoE models "
|
| 18 |
+
f"is not run inside this free Space — clone the repo and run `quickstart.py` on a "
|
| 19 |
+
f"capable host. You asked: {message!r}."
|
| 20 |
+
)
|
| 21 |
+
|
| 22 |
+
with gr.Blocks(css=THEME_CSS, title=TITLE) as demo:
|
| 23 |
+
gr.Markdown(f"# {TITLE}\n*Sovereign intelligence, held in the light.*\n\nLumynaX release scaffold — clone `{REPO_ID}` for the full package.")
|
| 24 |
+
gr.ChatInterface(chat_stub, examples=["Explain LumynaX in 2 bullets.", "Why local-first AI for Aotearoa?"])
|
| 25 |
+
|
| 26 |
+
if __name__ == "__main__":
|
| 27 |
+
demo.launch()
|
hf_space/requirements.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
gradio==5.50.0
|
ollama/Modelfile
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FROM hf.co/bartowski/starcoder2-15b-instruct-v0.1-GGUF
|
| 2 |
+
|
| 3 |
+
PARAMETER temperature 0.4
|
| 4 |
+
PARAMETER top_p 0.9
|
| 5 |
+
PARAMETER num_ctx 16384
|
| 6 |
+
|
| 7 |
+
SYSTEM """You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. Ko te marama te tuapapa. Answer with care; cite uncertainty; refuse unsafe asks."""
|
quickstart.py
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
"""
|
| 2 |
+
LumynaX Coder StarCoder2 15B Instruct GGUF — LumynaX quickstart.
|
| 3 |
+
|
| 4 |
+
This script fetches the upstream model from Hugging Face and runs a short
|
| 5 |
+
LumynaX-flavoured prompt. Run it on a host that satisfies the resource budget
|
| 6 |
+
documented in the README (LumynaX Coder StarCoder2 15B Instruct GGUF).
|
| 7 |
+
|
| 8 |
+
Usage:
|
| 9 |
+
python quickstart.py # one-shot demo prompt
|
| 10 |
+
python quickstart.py --interactive # REPL
|
| 11 |
+
python quickstart.py --gguf # use the GGUF mirror via llama-cpp
|
| 12 |
+
|
| 13 |
+
LumynaX package repo: https://huggingface.co/AbteeXAILab/lumynax-coder-starcoder2-15b-gguf
|
| 14 |
+
Upstream weights: https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1
|
| 15 |
+
"""
|
| 16 |
+
from __future__ import annotations
|
| 17 |
+
import argparse, os, sys
|
| 18 |
+
|
| 19 |
+
LUMYNAX_SYSTEM = (
|
| 20 |
+
"You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. "
|
| 21 |
+
"Ko te marama te tuapapa - the light is the foundation. "
|
| 22 |
+
"Answer with care, cite uncertainty, and prefer local-first reasoning. "
|
| 23 |
+
"Refuse unsafe, unlawful, or sovereignty-violating requests."
|
| 24 |
+
)
|
| 25 |
+
DEMO_PROMPT = "Explain in 3 bullets why local-first AI matters for Aotearoa New Zealand."
|
| 26 |
+
|
| 27 |
+
def _run_gguf(prompt: str, interactive: bool):
|
| 28 |
+
from llama_cpp import Llama
|
| 29 |
+
print("[lumynax] Loading GGUF from bartowski/starcoder2-15b-instruct-v0.1-GGUF (this can be large)...")
|
| 30 |
+
llm = Llama.from_pretrained(
|
| 31 |
+
repo_id="bartowski/starcoder2-15b-instruct-v0.1-GGUF",
|
| 32 |
+
filename="starcoder2-15b-instruct-v0.1-Q4_K_M.gguf",
|
| 33 |
+
n_ctx=16384,
|
| 34 |
+
n_gpu_layers=int(os.environ.get("N_GPU_LAYERS", "-1")),
|
| 35 |
+
verbose=False,
|
| 36 |
+
)
|
| 37 |
+
def chat(user):
|
| 38 |
+
out = llm.create_chat_completion(messages=[
|
| 39 |
+
{"role": "system", "content": LUMYNAX_SYSTEM},
|
| 40 |
+
{"role": "user", "content": user},
|
| 41 |
+
], max_tokens=512, temperature=0.4)
|
| 42 |
+
return out["choices"][0]["message"]["content"]
|
| 43 |
+
if interactive:
|
| 44 |
+
print("[lumynax] interactive mode — empty line exits.")
|
| 45 |
+
while True:
|
| 46 |
+
try: q = input("you> ").strip()
|
| 47 |
+
except EOFError: break
|
| 48 |
+
if not q: break
|
| 49 |
+
print("lumynax> " + chat(q))
|
| 50 |
+
else:
|
| 51 |
+
print(chat(prompt))
|
| 52 |
+
|
| 53 |
+
|
| 54 |
+
def main():
|
| 55 |
+
p = argparse.ArgumentParser()
|
| 56 |
+
p.add_argument("--interactive", action="store_true")
|
| 57 |
+
p.add_argument("--prompt", default=DEMO_PROMPT)
|
| 58 |
+
p.add_argument("--gguf", action="store_true", help="kept for compatibility — this build is GGUF-only")
|
| 59 |
+
args = p.parse_args()
|
| 60 |
+
_run_gguf(args.prompt, args.interactive)
|
| 61 |
+
|
| 62 |
+
|
| 63 |
+
if __name__ == "__main__":
|
| 64 |
+
main()
|
release_export_manifest.json
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"release_id": "lumynax-coder-starcoder2-15b-gguf",
|
| 3 |
+
"title": "LumynaX Coder StarCoder2 15B Instruct GGUF",
|
| 4 |
+
"repo_id": "AbteeXAILab/lumynax-coder-starcoder2-15b-gguf",
|
| 5 |
+
"version": "v0.1.0",
|
| 6 |
+
"publisher": "AbteeX AI Labs",
|
| 7 |
+
"publisher_org": "AbteeXAILab",
|
| 8 |
+
"jurisdiction": "NZ",
|
| 9 |
+
"residency": [
|
| 10 |
+
"NZ"
|
| 11 |
+
],
|
| 12 |
+
"upstream": {
|
| 13 |
+
"repo_id": "bigcode/starcoder2-15b-instruct-v0.1",
|
| 14 |
+
"license": "apache-2.0",
|
| 15 |
+
"prompt_format": "chatml",
|
| 16 |
+
"source_note": "bigcode/starcoder2-15b-instruct-v0.1"
|
| 17 |
+
},
|
| 18 |
+
"gguf_mirror": "bartowski/starcoder2-15b-instruct-v0.1-GGUF",
|
| 19 |
+
"runtime": "llama_cpp",
|
| 20 |
+
"modalities": [
|
| 21 |
+
"text"
|
| 22 |
+
],
|
| 23 |
+
"context_tokens": 16384,
|
| 24 |
+
"total_params_b": 15,
|
| 25 |
+
"active_params_b": null,
|
| 26 |
+
"quantization": "Q4_K_M GGUF",
|
| 27 |
+
"primary_artifact": "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf",
|
| 28 |
+
"package_state": "weights_mirrored",
|
| 29 |
+
"validation_status": "scaffold_verified",
|
| 30 |
+
"sovereignty_tier": 3,
|
| 31 |
+
"supports_tools": true,
|
| 32 |
+
"supports_json": true,
|
| 33 |
+
"audit_hash_chain": "SHA-256 over canonical request + response JSON",
|
| 34 |
+
"build_date_utc": "2026-05-17T10:35:18Z"
|
| 35 |
+
}
|
requirements.txt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
huggingface_hub>=0.27
|
| 2 |
+
numpy
|
| 3 |
+
llama-cpp-python>=0.3.2
|