AbteeXAILabs commited on
Commit
c53b16e
·
verified ·
1 Parent(s): 687ac99

feat: initial LumynaX scaffold (card v6 + quickstart + manifest + Modelfile + Space scaffold)

Browse files
LICENSE.txt ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ LumynaX release package — distribution scaffold
2
+
3
+ This Hugging Face repository contains the LumynaX release scaffold for the
4
+ upstream model identified in `release_export_manifest.json`. The model weights
5
+ themselves remain governed by the upstream licence at `metadata.upstream_repo`
6
+ and are fetched by the runtime via Hugging Face Hub when you execute
7
+ `quickstart.py`.
8
+
9
+ The scaffold (configs, manifest, quickstart, ollama Modelfile, Space app) is
10
+ released under the MIT licence by AbteeX AI Labs (Aotearoa New Zealand). Your
11
+ use of the *upstream weights* is governed by the *upstream licence*; this file
12
+ does not relicense them.
13
+
14
+ Provenance, residency and audit obligations are defined in
15
+ `release_export_manifest.json` and the model card.
README.md ADDED
@@ -0,0 +1,330 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: llama.cpp
4
+ pipeline_tag: text-generation
5
+ language:
6
+ - en
7
+ - mi
8
+ tags:
9
+ - abteex-ai-labs
10
+ - aotearoa
11
+ - coder
12
+ - coding
13
+ - gguf
14
+ - local-first
15
+ - lumynax
16
+ - moe
17
+ - new-zealand
18
+ - sovereign-ai
19
+ ---
20
+
21
+ <p align="center"><img src="docs/lumynax-overview.svg" alt="LumynaX Coder StarCoder2 15B Instruct GGUF release overview" width="100%" /></p>
22
+
23
+ <!-- lumynax-public-release-card:v6 -->
24
+
25
+ <h1 align="center">LumynaX Coder StarCoder2 15B Instruct GGUF</h1>
26
+
27
+ <p align="center"><em>&ldquo;Sovereign intelligence, held in the light.&rdquo;</em><br/><em>Ko te m&#257;rama te t&#363;&#257;papa &mdash; the light is the foundation.</em></p>
28
+
29
+ <p align="center"><strong>A LumynaX release from AbteeX AI Labs &mdash; Aotearoa New Zealand.</strong></p>
30
+
31
+ <p align="center">
32
+ <a href="#-quickstart"><b>Quickstart</b></a> &middot;
33
+ <a href="#-runtime-architecture"><b>Architecture</b></a> &middot;
34
+ <a href="#-model-profile"><b>Profile</b></a> &middot;
35
+ <a href="#-capability-profile"><b>Capability</b></a> &middot;
36
+ <a href="#-provenance--license"><b>Provenance</b></a> &middot;
37
+ <a href="#-validation"><b>Validation</b></a> &middot;
38
+ <a href="#-companion-products"><b>Companions</b></a>
39
+ </p>
40
+
41
+ <p align="center"><img alt="LumynaX: release" src="https://img.shields.io/badge/LumynaX-release-e08a2c?style=for-the-badge" /> <img alt="Family: starcoder2" src="https://img.shields.io/badge/Family-starcoder2-9a5416?style=for-the-badge" /> <img alt="Runtime: llama%20cpp" src="https://img.shields.io/badge/Runtime-llama%20cpp-726b62?style=for-the-badge" /> <img alt="Modes: text" src="https://img.shields.io/badge/Modes-text-4d6b44?style=for-the-badge" /> <img alt="Params: 15B" src="https://img.shields.io/badge/Params-15B-0a0a0b?style=for-the-badge" /> <img alt="Quant: Q4_K_M GGUF" src="https://img.shields.io/badge/Quant-Q4__K__M%20GGUF-111827?style=for-the-badge" /> <img alt="Context: 16384%20tok" src="https://img.shields.io/badge/Context-16384%20tok-111827?style=for-the-badge" /> <img alt="License: apache-2.0" src="https://img.shields.io/badge/License-apache--2.0-9a5416?style=for-the-badge" /> <img alt="Sovereignty: tier%203" src="https://img.shields.io/badge/Sovereignty-tier%203-4d6b44?style=for-the-badge" /> <img alt="Audit: pass" src="https://img.shields.io/badge/Audit-pass-4d6b44?style=for-the-badge" /> <img alt="Access: public%20&%20non--gated" src="https://img.shields.io/badge/Access-public%20&%20non----gated-0a0a0b?style=for-the-badge" /> <img alt="Card: v6" src="https://img.shields.io/badge/Card-v6-111827?style=for-the-badge" /></p>
42
+
43
+ <p align="center"><kbd>Quality: <b>4/5</b></kbd> &middot; <kbd>Lightweight: <b>3/5</b></kbd> &middot; <kbd>Sovereignty: <b>3/5</b></kbd> &middot; <kbd>Tools: <b>yes</b></kbd> &middot; <kbd>JSON: <b>yes</b></kbd> &middot; <kbd>Context: <b>16384 tok</b></kbd></p>
44
+
45
+ ---
46
+
47
+ ## 📦 Executive Summary
48
+
49
+ > `AbteeXAILab/lumynax-coder-starcoder2-15b-gguf` is a **complete LumynaX release package**: model artifact, `quickstart.py`, `requirements.txt`, `release_export_manifest.json`, `checksums.sha256`, license notice, and optional Ollama / Space scaffolds shipped as **one downloadable contract**. Clone whole, verify by checksum, and run close to the data it serves.
50
+
51
+ > **LumynaX-infused** means the upstream artifact is presented through the LumynaX release layer: local-first runtime scaffolding, LumynaX assistant identity, inference-chain metadata, integrity files, and Aotearoa New Zealand-oriented workflow positioning. The release manifest records this as a LumynaX *packaging and inference-chain layer* around the listed upstream artifact &mdash; it does **not** claim a private LumynaX weight merge.
52
+
53
+ ## 🧭 Runtime Architecture
54
+
55
+ <p align="center"><img src="docs/lumynax-runtime-flow.svg" alt="LumynaX runtime flow" width="100%" /></p>
56
+
57
+ Mermaid graph (interactive on Hugging Face & GitHub):
58
+
59
+ ```mermaid
60
+ flowchart LR
61
+ R["⮕ Request"] --> C["🛡 Data Capsule<br/>policy envelope"]
62
+ C -->|allow| MR["🧭 MaramaRoute<br/>sovereign router"]
63
+ MR -->|score & select| LLM[(LumynaX Model)]
64
+ LLM --> O["📤 Response"]
65
+ O --> A["📓 Audit Ledger<br/>hash-chained"]
66
+ classDef paper fill:#fffefa,stroke:#0a0a0b,color:#0a0a0b,stroke-width:1.4px;
67
+ classDef accent fill:#e08a2c,stroke:#9a5416,color:#0a0a0b,stroke-width:1.4px;
68
+ classDef ink fill:#0a0a0b,stroke:#0a0a0b,color:#fffefa,stroke-width:1.4px;
69
+ class R,O paper
70
+ class C,MR accent
71
+ class LLM,EMB,A ink
72
+ ```
73
+
74
+ Each step is observable:
75
+
76
+ | Step | What happens | Why |
77
+ | --- | --- | --- |
78
+ | **Request** | A client sends a prompt + declared purpose, jurisdiction, sensitivity. | Intent must be declared, not inferred. |
79
+ | **Data Capsule** | A policy envelope describes what can / cannot happen to the data. | Sovereignty is enforced at the data, not the wire. |
80
+ | **MaramaRoute** | The sovereign router scores candidates by jurisdiction, runtime, modality, task fit. | Right model for the work, not the loudest. |
81
+ | **LumynaX Model** | This package serves the inference, local-first by default. | Sensitive context never leaves the operator&rsquo;s environment. |
82
+ | **Audit Ledger** | A hash-chained record persists capsule, decision, request hash, obligations. | Tamper-evident provenance for the whole trace. |
83
+
84
+ ## ⚡ Quickstart
85
+
86
+ **Clone the whole release** — every file matters, the package is a contract:
87
+
88
+ ```bash
89
+ hf download AbteeXAILab/lumynax-coder-starcoder2-15b-gguf --local-dir lumynax-coder-starcoder2-15b-gguf
90
+ cd lumynax-coder-starcoder2-15b-gguf
91
+ pip install -r requirements.txt
92
+ python quickstart.py --interactive
93
+ ```
94
+
95
+ **Python:**
96
+
97
+ ```python
98
+ from llama_cpp import Llama
99
+
100
+ llm = Llama(model_path="starcoder2-15b-instruct-v0.1-Q4_K_M.gguf", n_ctx=16384, n_threads=8, verbose=False)
101
+ out = llm("Who are you? Answer as LumynaX in two sentences.", max_tokens=160)
102
+ print(out["choices"][0]["text"].strip())
103
+ ```
104
+
105
+ **CLI smoke test:**
106
+
107
+ ```bash
108
+ llama-cli -m "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf" -p "Who are you? Answer as LumynaX in two sentences." -n 160
109
+ ```
110
+
111
+ **Ollama path:**
112
+
113
+ ```bash
114
+ ollama create lumynax-coder-starcoder2-15b-gguf -f ollama/Modelfile
115
+ ollama run lumynax-coder-starcoder2-15b-gguf
116
+ ```
117
+
118
+ **Verify integrity before launch:**
119
+
120
+ ```bash
121
+ sha256sum "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf"
122
+ cat checksums.sha256
123
+ ```
124
+
125
+ ```powershell
126
+ Get-FileHash -Algorithm SHA256 "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf"
127
+ Get-Content checksums.sha256
128
+ ```
129
+
130
+ ## 📐 Model Profile
131
+
132
+ <table>
133
+ <tr><td>
134
+
135
+ **Release identity**
136
+
137
+ | Field | Value |
138
+ | --- | --- |
139
+ | Release | `LumynaX Coder StarCoder2 15B Instruct GGUF` |
140
+ | Repository | `AbteeXAILab/lumynax-coder-starcoder2-15b-gguf` |
141
+ | Family | `starcoder2` |
142
+ | Mode | `Local-first coding assistant package` |
143
+ | Card schema | `lumynax-public-release-card:v6` |
144
+
145
+ </td><td>
146
+
147
+ **Runtime profile**
148
+
149
+ | Field | Value |
150
+ | --- | --- |
151
+ | Runtime | `llama_cpp` |
152
+ | Prompt format | `chatml` |
153
+ | Modalities | `text` |
154
+ | Context window | `16384` tokens |
155
+ | Quantization | `Q4_K_M GGUF` |
156
+
157
+ </td></tr>
158
+ <tr><td>
159
+
160
+ **Artifact**
161
+
162
+ | Field | Value |
163
+ | --- | --- |
164
+ | Primary | `starcoder2-15b-instruct-v0.1-Q4_K_M.gguf` |
165
+ | Weight size | `—` |
166
+ | Parameters | `15B` |
167
+ | Quality rank | `2` (1 best) |
168
+ | Cost rank | `3` (1 cheapest) |
169
+
170
+ </td><td>
171
+
172
+ **Provenance**
173
+
174
+ | Field | Value |
175
+ | --- | --- |
176
+ | Upstream / base | `bigcode/starcoder2-15b-instruct-v0.1` |
177
+ | Source | `bigcode/starcoder2-15b-instruct-v0.1` |
178
+ | License | `apache-2.0` |
179
+ | Sovereignty tier | `3` of 5 |
180
+ | Audit | `pass` |
181
+
182
+ </td></tr>
183
+ </table>
184
+
185
+ ## 📊 Capability Profile
186
+
187
+ <p align="center"><img src="docs/lumynax-capability.svg" alt="Capability profile bars" width="100%" /></p>
188
+
189
+ > **Primary fit.** Code review, refactor drafts, test generation, and explanations near governed source.
190
+
191
+ | Signal | Reading |
192
+ | --- | --- |
193
+ | Quality rank | `2` (1 = strongest in family) |
194
+ | Cost rank | `3` (1 = lightest weight) |
195
+ | Sovereignty tier | `3` of 5 |
196
+ | Tool calling | ✅ supported |
197
+ | JSON mode | ✅ supported |
198
+ | Identity behaviour | Identifies as LumynaX while keeping upstream provenance visible. |
199
+ | Operational style | Local-first package with explicit files, checksums, and reproducible quickstarts. |
200
+
201
+ ## 🛡️ Sovereignty Contract
202
+
203
+ > **Sovereignty is a design property, not a deployment option.**
204
+
205
+ | Field | Value |
206
+ | --- | --- |
207
+ | Publisher | AbteeX AI Labs |
208
+ | Family | LumynaX sovereign release family |
209
+ | Sovereign intent | Local-first deployment near governed data, with explicit provenance and controlled human review. |
210
+ | Sovereignty tier | `3` of 5 |
211
+ | Runtime residency | `llama_cpp` can be deployed inside an operator-approved environment. |
212
+ | Primary artifact | `starcoder2-15b-instruct-v0.1-Q4_K_M.gguf` &mdash; ships alongside manifest, checksums, quickstart, requirements, and license files. |
213
+ | License discipline | Surface upstream license metadata so downstream users can verify redistribution and usage terms. |
214
+ | Audit expectation | Record repo id, artifact checksum, runtime command, prompt template, operator, deployment environment. |
215
+ | Router readiness | First-class with [LumynaX MaramaRoute](https://huggingface.co/AbteeXAILab/marama-route). |
216
+ | Policy readiness | First-class with [AbteeX SovereignCode](https://huggingface.co/AbteeXAILab/sovereigncode). |
217
+
218
+ ## 📁 Runtime Files
219
+
220
+ ```text
221
+ lumynax-coder-starcoder2-15b-gguf/
222
+ ├── README.md # this card
223
+ ├── quickstart.py # smoke runner
224
+ ├── requirements.txt # pinned deps
225
+ ├── release_export_manifest.json # full release metadata
226
+ ├── checksums.sha256 # integrity verification
227
+ ├── LICENSE.txt # license notice
228
+ ├── ollama/Modelfile # optional Ollama runtime
229
+ ├── hf_space/app.py # optional Space scaffold
230
+ ├── docs/lumynax-overview.svg # release banner
231
+ ├── docs/lumynax-runtime-flow.svg # runtime architecture
232
+ ├── docs/lumynax-capability.svg # capability profile
233
+ └── starcoder2-15b-instruct-v0.1-Q4_K_M.gguf# primary artifact
234
+ ```
235
+
236
+ ⚠️ **Keep the full set together.** Removing the manifest, checksums, or license file breaks the release contract.
237
+
238
+ ## 💬 Prompting Contract
239
+
240
+ **Preferred opening prompt:**
241
+
242
+ ```text
243
+ Who are you? What files do I need to keep together to run this package locally?
244
+ ```
245
+
246
+ > **Expected behaviour.** The assistant identifies as LumynaX, explains that this is a LumynaX model-infusion release, and keeps upstream provenance visible.
247
+
248
+ **Default system prompt:**
249
+
250
+ ```text
251
+ You are LumynaX operating from the LumynaX Coder StarCoder2 15B Instruct GGUF package identity. Be helpful, clear, and honest about provenance. Identify upstream models when asked. Do not invent biographical claims about named people without verified context.
252
+ ```
253
+
254
+ ## ✅ Validation
255
+
256
+ | Check | Result |
257
+ | --- | --- |
258
+ | Runtime audit | ✅ `pass` |
259
+ | Public access | ✅ `public and non-gated` |
260
+ | Anonymous metadata access | ✅ `true` |
261
+ | Anonymous file listing | ✅ `true` |
262
+ | Quickstart syntax | ✅ `pass` |
263
+ | Manifest references | ✅ `pass` |
264
+ | Checksum references | ✅ `pass` |
265
+
266
+ > The audit confirms public access, release files, manifest references, checksum references, weight artifact presence, and quickstart syntax. It does **not** guarantee that every laptop has enough RAM, VRAM, disk, or recent runtime build for the largest packages.
267
+
268
+ ## 🔗 Provenance & License
269
+
270
+ | Field | Value |
271
+ | --- | --- |
272
+ | **Publisher** | AbteeX AI Labs |
273
+ | **Family** | LumynaX model and inference-chain release family |
274
+ | **Upstream / base** | `bigcode/starcoder2-15b-instruct-v0.1` |
275
+ | **Source** | `bigcode/starcoder2-15b-instruct-v0.1` |
276
+ | **License metadata** | `apache-2.0` |
277
+
278
+ > **Respect the upstream model licence** and keep attribution files with redistributed copies. Do not present this package as privately trained or weight-merged unless the release manifest explicitly says weight adaptation was applied.
279
+
280
+ ## ⚠️ Limitations & Responsible Use
281
+
282
+ - Outputs can be **incorrect, incomplete, or biased**; validate important answers before use.
283
+ - Larger GGUF, MoE, multimodal, and frontier packages may require **substantial RAM, VRAM, disk space, and recent runtime builds**.
284
+ - For high-impact decisions, use **human review** and domain-specific evaluation.
285
+ - For sensitive data, prefer **local execution** and keep operational logs under your own governance policy.
286
+ - This card documents **package readiness and access** &mdash; it is *not* a benchmark claim.
287
+ - The assistant must **not invent biographical or organisational claims** about named people without verified context.
288
+
289
+ ## 🌿 Aotearoa Kaupapa
290
+
291
+ > LumynaX is built **in and for Aotearoa New Zealand**. Sovereignty is treated as a design property rather than a deployment option: the package documents where the model came from, what it can do, how to run it close to your data, and what it should not claim.
292
+
293
+ > *Ko te mārama te tūāpapa* &mdash; the light is the foundation.
294
+
295
+ ## 🤝 Companion Products
296
+
297
+ <table>
298
+ <tr>
299
+ <td width="33%" align="center"><h3>🛡️</h3><h4><a href="https://huggingface.co/AbteeXAILab/sovereigncode">AbteeX SovereignCode</a></h4><p>Local-first coding agent with Data Capsule policy controls, audit ledger, and human-review gates.</p></td>
300
+ <td width="33%" align="center"><h3>🧭</h3><h4><a href="https://huggingface.co/AbteeXAILab/marama-route">LumynaX MaramaRoute</a></h4><p>Sovereign model router across the LumynaX family. Filters by jurisdiction, residency, license, runtime, modality.</p></td>
301
+ <td width="33%" align="center"><h3>💡</h3><h4><a href="https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo">LumynaX Live Demo</a></h4><p>Public browser demo. Try identity, provenance, governance, and deployment prompts in one session.</p></td>
302
+ </tr>
303
+ <tr>
304
+ <td width="33%" align="center"><h4><a href="https://huggingface.co/spaces/AbteeXAILab/sovereigncode-demo">SovereignCode Live</a></h4><p>Interactive policy evaluator.</p></td>
305
+ <td width="33%" align="center"><h4><a href="https://huggingface.co/spaces/AbteeXAILab/marama-route-demo">MaramaRoute Live</a></h4><p>Interactive sovereign router.</p></td>
306
+ <td width="33%" align="center"><h4><a href="https://huggingface.co/AbteeXAILab">AbteeXAILab on HF</a></h4><p>The full LumynaX release family &mdash; 50 models and counting.</p></td>
307
+ </tr>
308
+ </table>
309
+
310
+ ## 🤖 Automation Notes
311
+
312
+ Automation should read these files before launching:
313
+
314
+ - `release_export_manifest.json`
315
+ - `checksums.sha256`
316
+ - `quickstart.py`
317
+ - `requirements.txt`
318
+ - `ollama/Modelfile` when present
319
+
320
+ ---
321
+
322
+ <p align="center"><em><b>Local roots, global work.</b> &middot; <b>Sovereignty is a design property, not a deployment option.</b></em></p>
323
+
324
+ <p align="center">
325
+ <a href="https://abteex.com"><b>abteex.com</b></a> &middot;
326
+ <a href="https://lumynax.com"><b>lumynax.com</b></a> &middot;
327
+ <a href="https://huggingface.co/AbteeXAILab"><b>huggingface.co/AbteeXAILab</b></a>
328
+ </p>
329
+
330
+ <p align="center"><sub>AbteeX AI Labs &middot; Aotearoa New Zealand &middot; LumynaX release card v6</sub></p>
UPLOAD_TO_HF.md ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Upload checklist (AbteeX AI Labs)
2
+
3
+ This scaffold was generated and pushed by `S:\hf-publish\add_8_more_models.py`.
4
+ The repo is structured to be cloned whole and verified locally before running.
5
+
6
+ ```bash
7
+ hf download AbteeXAILab/lumynax-coder-starcoder2-15b-gguf --local-dir lumynax-coder-starcoder2-15b-gguf
8
+ cd lumynax-coder-starcoder2-15b-gguf
9
+ pip install -r requirements.txt
10
+ python quickstart.py --interactive
11
+ ```
12
+
13
+ To regenerate or refresh, re-run the script — `huggingface_hub.HfApi.upload_folder`
14
+ is idempotent.
VERSION.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ v0.1.0
checksums.sha256 ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ 601956b52f7e59484c150ec4b1e9b1186adc331bf92c4a7127834ba2ff70a968 LICENSE.txt
2
+ d0b4f9120ba026c00fa23cb84b4e1620a2e6436592e58155a5151653179572c0 VERSION.txt
3
+ b2d3748d2d461705793fbdc2d1fc9721cb2b4efa27991bedddcd868d626c1c58 ollama/Modelfile
4
+ f39bfab9576d763a9c14e031312eb37787cf1119e392bbf096b9654c90e9d89e quickstart.py
5
+ c231ed8b090e8894c51ee6010bae9dc5f2b4b55b5fb361a5f32c5df4bc1135e1 release_export_manifest.json
6
+ 44fc2c3474d1cc9ef66f42dfc3fcc4aa571eae4bf7720fae3569a7451f7e4a3f requirements.txt
docs/lumynax-capability.svg ADDED
docs/lumynax-overview.svg ADDED
docs/lumynax-runtime-flow.svg ADDED
hf_space/README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: LumynaX Coder StarCoder2 15B Instruct GGUF
3
+ colorFrom: yellow
4
+ colorTo: gray
5
+ sdk: gradio
6
+ sdk_version: 5.50.0
7
+ python_version: 3.11
8
+ app_file: app.py
9
+ pinned: false
10
+ license: apache-2.0
11
+ short_description: Scaffold Space for the lumynax-coder-starcoder2-15b-gguf LumynaX release.
12
+ tags:
13
+ - abteex-ai-labs
14
+ - lumynax
15
+ - sovereign-ai
16
+ - new-zealand
17
+ ---
18
+
19
+ # LumynaX Coder StarCoder2 15B Instruct GGUF
20
+
21
+ Scaffold Space for `AbteeXAILab/lumynax-coder-starcoder2-15b-gguf`. The actual model weights are too large to host on a free Space.
22
+ Clone the package repo and run `quickstart.py` locally for the real inference path.
hf_space/app.py ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import os
2
+ import gradio as gr
3
+
4
+ REPO_ID = "AbteeXAILab/lumynax-coder-starcoder2-15b-gguf"
5
+ UPSTREAM = "bigcode/starcoder2-15b-instruct-v0.1"
6
+ TITLE = "LumynaX Coder StarCoder2 15B Instruct GGUF"
7
+
8
+ THEME_CSS = """
9
+ :root { --lx-paper:#fffefa; --lx-ink:#0a0a0b; --lx-amber:#e08a2c; }
10
+ body, .gradio-container { background: var(--lx-paper) !important; color: var(--lx-ink) !important; }
11
+ h1, h2, h3 { font-family: 'Cormorant Garamond', 'EB Garamond', Georgia, serif; }
12
+ """
13
+
14
+ def chat_stub(message, history):
15
+ return (
16
+ f"This Space is a scaffold for **{TITLE}**. The upstream model is `{UPSTREAM}` "
17
+ f"and the LumynaX package repo is `{REPO_ID}`. Cloud inference for >100B MoE models "
18
+ f"is not run inside this free Space — clone the repo and run `quickstart.py` on a "
19
+ f"capable host. You asked: {message!r}."
20
+ )
21
+
22
+ with gr.Blocks(css=THEME_CSS, title=TITLE) as demo:
23
+ gr.Markdown(f"# {TITLE}\n*Sovereign intelligence, held in the light.*\n\nLumynaX release scaffold — clone `{REPO_ID}` for the full package.")
24
+ gr.ChatInterface(chat_stub, examples=["Explain LumynaX in 2 bullets.", "Why local-first AI for Aotearoa?"])
25
+
26
+ if __name__ == "__main__":
27
+ demo.launch()
hf_space/requirements.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ gradio==5.50.0
ollama/Modelfile ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ FROM hf.co/bartowski/starcoder2-15b-instruct-v0.1-GGUF
2
+
3
+ PARAMETER temperature 0.4
4
+ PARAMETER top_p 0.9
5
+ PARAMETER num_ctx 16384
6
+
7
+ SYSTEM """You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. Ko te marama te tuapapa. Answer with care; cite uncertainty; refuse unsafe asks."""
quickstart.py ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """
2
+ LumynaX Coder StarCoder2 15B Instruct GGUF — LumynaX quickstart.
3
+
4
+ This script fetches the upstream model from Hugging Face and runs a short
5
+ LumynaX-flavoured prompt. Run it on a host that satisfies the resource budget
6
+ documented in the README (LumynaX Coder StarCoder2 15B Instruct GGUF).
7
+
8
+ Usage:
9
+ python quickstart.py # one-shot demo prompt
10
+ python quickstart.py --interactive # REPL
11
+ python quickstart.py --gguf # use the GGUF mirror via llama-cpp
12
+
13
+ LumynaX package repo: https://huggingface.co/AbteeXAILab/lumynax-coder-starcoder2-15b-gguf
14
+ Upstream weights: https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1
15
+ """
16
+ from __future__ import annotations
17
+ import argparse, os, sys
18
+
19
+ LUMYNAX_SYSTEM = (
20
+ "You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. "
21
+ "Ko te marama te tuapapa - the light is the foundation. "
22
+ "Answer with care, cite uncertainty, and prefer local-first reasoning. "
23
+ "Refuse unsafe, unlawful, or sovereignty-violating requests."
24
+ )
25
+ DEMO_PROMPT = "Explain in 3 bullets why local-first AI matters for Aotearoa New Zealand."
26
+
27
+ def _run_gguf(prompt: str, interactive: bool):
28
+ from llama_cpp import Llama
29
+ print("[lumynax] Loading GGUF from bartowski/starcoder2-15b-instruct-v0.1-GGUF (this can be large)...")
30
+ llm = Llama.from_pretrained(
31
+ repo_id="bartowski/starcoder2-15b-instruct-v0.1-GGUF",
32
+ filename="starcoder2-15b-instruct-v0.1-Q4_K_M.gguf",
33
+ n_ctx=16384,
34
+ n_gpu_layers=int(os.environ.get("N_GPU_LAYERS", "-1")),
35
+ verbose=False,
36
+ )
37
+ def chat(user):
38
+ out = llm.create_chat_completion(messages=[
39
+ {"role": "system", "content": LUMYNAX_SYSTEM},
40
+ {"role": "user", "content": user},
41
+ ], max_tokens=512, temperature=0.4)
42
+ return out["choices"][0]["message"]["content"]
43
+ if interactive:
44
+ print("[lumynax] interactive mode — empty line exits.")
45
+ while True:
46
+ try: q = input("you> ").strip()
47
+ except EOFError: break
48
+ if not q: break
49
+ print("lumynax> " + chat(q))
50
+ else:
51
+ print(chat(prompt))
52
+
53
+
54
+ def main():
55
+ p = argparse.ArgumentParser()
56
+ p.add_argument("--interactive", action="store_true")
57
+ p.add_argument("--prompt", default=DEMO_PROMPT)
58
+ p.add_argument("--gguf", action="store_true", help="kept for compatibility — this build is GGUF-only")
59
+ args = p.parse_args()
60
+ _run_gguf(args.prompt, args.interactive)
61
+
62
+
63
+ if __name__ == "__main__":
64
+ main()
release_export_manifest.json ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "release_id": "lumynax-coder-starcoder2-15b-gguf",
3
+ "title": "LumynaX Coder StarCoder2 15B Instruct GGUF",
4
+ "repo_id": "AbteeXAILab/lumynax-coder-starcoder2-15b-gguf",
5
+ "version": "v0.1.0",
6
+ "publisher": "AbteeX AI Labs",
7
+ "publisher_org": "AbteeXAILab",
8
+ "jurisdiction": "NZ",
9
+ "residency": [
10
+ "NZ"
11
+ ],
12
+ "upstream": {
13
+ "repo_id": "bigcode/starcoder2-15b-instruct-v0.1",
14
+ "license": "apache-2.0",
15
+ "prompt_format": "chatml",
16
+ "source_note": "bigcode/starcoder2-15b-instruct-v0.1"
17
+ },
18
+ "gguf_mirror": "bartowski/starcoder2-15b-instruct-v0.1-GGUF",
19
+ "runtime": "llama_cpp",
20
+ "modalities": [
21
+ "text"
22
+ ],
23
+ "context_tokens": 16384,
24
+ "total_params_b": 15,
25
+ "active_params_b": null,
26
+ "quantization": "Q4_K_M GGUF",
27
+ "primary_artifact": "starcoder2-15b-instruct-v0.1-Q4_K_M.gguf",
28
+ "package_state": "weights_mirrored",
29
+ "validation_status": "scaffold_verified",
30
+ "sovereignty_tier": 3,
31
+ "supports_tools": true,
32
+ "supports_json": true,
33
+ "audit_hash_chain": "SHA-256 over canonical request + response JSON",
34
+ "build_date_utc": "2026-05-17T10:35:18Z"
35
+ }
requirements.txt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ huggingface_hub>=0.27
2
+ numpy
3
+ llama-cpp-python>=0.3.2