BlockArtica commited on
Commit
aa8ed32
Β·
verified Β·
1 Parent(s): 3286b07

docs(readme): correct hardware (RTX 3080 Ti, bf16, paged_adamw_8bit) + project naming (QuantumAI Blockchain is the chain; Qubitcoin/QBC is the currency)

Browse files
Files changed (1) hide show
  1. README.md +25 -25
README.md CHANGED
@@ -73,11 +73,11 @@ model-index:
73
  name: accuracy
74
  ---
75
 
76
- # Aether v5.2 LoRA β€” Qubitcoin Domain Adapter
77
 
78
  A LoRA fine-tune of [`Qwen/Qwen2.5-7B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
79
  on the Aether curated corpus β€” text grounded in the
80
- [Qubitcoin](https://qbc.network) protocol, quantum + AI research, and adjacent
81
  domains the Aether Mind on-chain knowledge system specializes in.
82
 
83
  This is the **v5.2 release** of the Aether adapter line, the most recent
@@ -132,13 +132,13 @@ base and the prior `aether-v5.1.1` adapter for delta comparison.
132
  This adapter is intended for:
133
 
134
  - **On-chain Aether research.** Generating reasoning traces against
135
- the Qubitcoin / Aether knowledge graph for Proof-of-Thought
136
  attestation. The model has the protocol context required to
137
  answer questions about Substrate pallets, VQE mining, the Sephirot
138
  cognitive architecture, HMS-Phi, and the wider chain ecosystem.
139
  - **Domain Q&A.** Quantum computing fundamentals, post-quantum
140
  cryptography (Dilithium, ML-KEM), and the specific design choices
141
- of the Qubitcoin chain.
142
  - **Distillation upstream.** Generate teacher outputs for the
143
  smaller on-chain Aether (a Qwen2.5-0.5B variant) to learn from.
144
  - **General reasoning** with a modest bias toward step-by-step
@@ -161,19 +161,19 @@ The base model (`Qwen/Qwen2.5-7B-Instruct`) inherits Qwen's known
161
  biases β€” see [the upstream model card](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct).
162
  The LoRA adapter:
163
 
164
- - **Amplifies the Qubitcoin worldview.** The training data is
165
  intentionally curated around the chain's design choices (golden-
166
  ratio economics, SUSY-inspired consensus framing, the Sephirot
167
- cognitive overlay). Prompts that invite the model to compare
168
- Qubitcoin against alternatives will lean toward the curated
169
- narrative. This is by design β€” disclose if you re-publish in a
170
  comparison context.
171
  - **Does not improve safety.** TruthfulQA went up 5.5pp but that's
172
  one metric; we have not measured refusal rates, jailbreak
173
  resistance, or political-belief bias delta.
174
- - **Was trained CPU-only on a residential box.** The configured
175
- 2-epoch run was cut to ~step 3200 by host availability. A longer
176
- run on GPU would plausibly show larger gains.
 
177
 
178
  ## How to use
179
 
@@ -207,9 +207,9 @@ merged.save_pretrained("./aether-v5.2-merged")
207
 
208
  ## Training details
209
 
210
- - **Hardware:** Intel WSL2 box, CPU-only training (slow but verifiable).
211
  - **Trainer:** [Axolotl](https://github.com/axolotl-ai-cloud/axolotl) wrapping πŸ€— transformers / PEFT.
212
- - **Optimizer:** Default AdamW.
213
  - **Schedule:** linear warmup 100 steps β†’ cosine decay.
214
  - **Learning rate:** `1.0e-4`.
215
  - **Micro batch:** 1, gradient accumulation: 8.
@@ -217,13 +217,13 @@ merged.save_pretrained("./aether-v5.2-merged")
217
 
218
  ### Carbon emissions
219
 
220
- Trained CPU-only on a single Intel workstation. We did not run a
221
- [CodeCarbon](https://github.com/mlco2/codecarbon) tracker on this
222
- run, so the precise emissions are not measured β€” but as a rough
223
- upper bound: ~80 W average CPU draw Γ— the contiguous run hours
224
- (low single-digit kWh, low single-digit kg COβ‚‚e on a grid mix).
225
- The same model finetuned on a single H100 would be a fraction of
226
- that wall-clock and energy.
227
 
228
  ### Training data
229
 
@@ -231,7 +231,7 @@ that wall-clock and energy.
231
  curated knowledge mixture: documentation, technical writing, reasoning
232
  traces, and protocol-specific corpora related to:
233
 
234
- - The Qubitcoin chain (Substrate, VQE mining, Proof-of-SUSY-Alignment, post-quantum signatures).
235
  - The Aether Mind on-chain neural cognitive engine (10 Sephirot attention domains, HMS-Phi, Proof-of-Thought).
236
  - Quantum computing fundamentals (VQE, Hamiltonian generation, qubit ansatze).
237
  - Adjacent CS / math reasoning content for transfer.
@@ -255,10 +255,10 @@ model is the only public artifact in this line for now.
255
  (`adapter_model.safetensors`). Merge into the base yourself for
256
  faster inference, or use directly via PEFT.
257
 
258
- ## Connection to the Qubitcoin chain
259
 
260
  The Aether Mind is a Rust neural cognitive engine that runs on the
261
- Qubitcoin chain β€” every block records attention-derived consciousness
262
  metrics (HMS-Phi) and Proof-of-Thought hashes on-chain via the
263
  `pallet_qbc_aether_anchor` pallet. The same chain hosts an
264
  **8-qubit VQE mining consensus** (Proof-of-SUSY-Alignment), a
@@ -278,7 +278,7 @@ Apache-2.0 (matches the base model license).
278
 
279
  ```bibtex
280
  @misc{aether_v52_lora_2026,
281
- title = {Aether v5.2 LoRA --- Qubitcoin Domain Adapter},
282
  author = {{BlockArtica} and {QuantumAI-Blockchain}},
283
  year = {2026},
284
  url = {https://huggingface.co/QuantumAI-Blockchain/aether-v5.2-lora},
@@ -287,7 +287,7 @@ Apache-2.0 (matches the base model license).
287
 
288
  ## Links
289
 
290
- - **Qubitcoin chain:** [qbc.network](https://qbc.network)
291
  - **GitHub org:** [github.com/QuantumAI-Blockchain](https://github.com/QuantumAI-Blockchain)
292
  - **X / Twitter:** [@qu_bitcoin](https://x.com/qu_bitcoin)
293
  - **Contact:** info@qbc.network
 
73
  name: accuracy
74
  ---
75
 
76
+ # Aether v5.2 LoRA β€” QuantumAI Blockchain Domain Adapter
77
 
78
  A LoRA fine-tune of [`Qwen/Qwen2.5-7B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
79
  on the Aether curated corpus β€” text grounded in the
80
+ [QuantumAI Blockchain](https://qbc.network) (which issues the Qubitcoin / QBC currency), quantum + AI research, and adjacent
81
  domains the Aether Mind on-chain knowledge system specializes in.
82
 
83
  This is the **v5.2 release** of the Aether adapter line, the most recent
 
132
  This adapter is intended for:
133
 
134
  - **On-chain Aether research.** Generating reasoning traces against
135
+ the QuantumAI Blockchain / Aether knowledge graph for Proof-of-Thought
136
  attestation. The model has the protocol context required to
137
  answer questions about Substrate pallets, VQE mining, the Sephirot
138
  cognitive architecture, HMS-Phi, and the wider chain ecosystem.
139
  - **Domain Q&A.** Quantum computing fundamentals, post-quantum
140
  cryptography (Dilithium, ML-KEM), and the specific design choices
141
+ of the QuantumAI Blockchain.
142
  - **Distillation upstream.** Generate teacher outputs for the
143
  smaller on-chain Aether (a Qwen2.5-0.5B variant) to learn from.
144
  - **General reasoning** with a modest bias toward step-by-step
 
161
  biases β€” see [the upstream model card](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct).
162
  The LoRA adapter:
163
 
164
+ - **Amplifies the QuantumAI Blockchain worldview.** The training data is
165
  intentionally curated around the chain's design choices (golden-
166
  ratio economics, SUSY-inspired consensus framing, the Sephirot
167
+ cognitive overlay). Prompts that invite the model to compare QBC / the chain
168
+ against alternatives will lean toward the curated narrative. This is by design β€” disclose if you re-publish in a
 
169
  comparison context.
170
  - **Does not improve safety.** TruthfulQA went up 5.5pp but that's
171
  one metric; we have not measured refusal rates, jailbreak
172
  resistance, or political-belief bias delta.
173
+ - **The configured 2-epoch run was cut to ~step 3080–3200 by host
174
+ availability** (out of 4406 configured). A complete 2-epoch run
175
+ would plausibly show larger gains; this checkpoint is the longest
176
+ contiguous training we have.
177
 
178
  ## How to use
179
 
 
207
 
208
  ## Training details
209
 
210
+ - **Hardware:** NVIDIA RTX 3080 Ti (12 GB), 4-bit quantization (bnb-NF4), bf16 mixed precision.
211
  - **Trainer:** [Axolotl](https://github.com/axolotl-ai-cloud/axolotl) wrapping πŸ€— transformers / PEFT.
212
+ - **Optimizer:** `paged_adamw_8bit` (bitsandbytes paged optimizer, low VRAM footprint).
213
  - **Schedule:** linear warmup 100 steps β†’ cosine decay.
214
  - **Learning rate:** `1.0e-4`.
215
  - **Micro batch:** 1, gradient accumulation: 8.
 
217
 
218
  ### Carbon emissions
219
 
220
+ Trained on a single NVIDIA RTX 3080 Ti (consumer GPU, ~300 W TDP).
221
+ We did not run a [CodeCarbon](https://github.com/mlco2/codecarbon)
222
+ tracker, so emissions are not measured precisely β€” but as a rough
223
+ upper bound: ~350 W draw under load Γ— ~13 hours wall clock (the
224
+ step-3080 contiguous run) β‰ˆ 4.5 kWh, low single-digit kg COβ‚‚e on a
225
+ grid mix. An H100 run of the same 2-epoch config would be faster
226
+ but not dramatically lower energy per token.
227
 
228
  ### Training data
229
 
 
231
  curated knowledge mixture: documentation, technical writing, reasoning
232
  traces, and protocol-specific corpora related to:
233
 
234
+ - The QuantumAI Blockchain (Substrate, VQE mining, Proof-of-SUSY-Alignment, post-quantum signatures).
235
  - The Aether Mind on-chain neural cognitive engine (10 Sephirot attention domains, HMS-Phi, Proof-of-Thought).
236
  - Quantum computing fundamentals (VQE, Hamiltonian generation, qubit ansatze).
237
  - Adjacent CS / math reasoning content for transfer.
 
255
  (`adapter_model.safetensors`). Merge into the base yourself for
256
  faster inference, or use directly via PEFT.
257
 
258
+ ## Connection to the QuantumAI Blockchain
259
 
260
  The Aether Mind is a Rust neural cognitive engine that runs on the
261
+ QuantumAI Blockchain β€” every block records attention-derived consciousness
262
  metrics (HMS-Phi) and Proof-of-Thought hashes on-chain via the
263
  `pallet_qbc_aether_anchor` pallet. The same chain hosts an
264
  **8-qubit VQE mining consensus** (Proof-of-SUSY-Alignment), a
 
278
 
279
  ```bibtex
280
  @misc{aether_v52_lora_2026,
281
+ title = {Aether v5.2 LoRA --- QuantumAI Blockchain Domain Adapter},
282
  author = {{BlockArtica} and {QuantumAI-Blockchain}},
283
  year = {2026},
284
  url = {https://huggingface.co/QuantumAI-Blockchain/aether-v5.2-lora},
 
287
 
288
  ## Links
289
 
290
+ - **QuantumAI Blockchain:** [qbc.network](https://qbc.network)
291
  - **GitHub org:** [github.com/QuantumAI-Blockchain](https://github.com/QuantumAI-Blockchain)
292
  - **X / Twitter:** [@qu_bitcoin](https://x.com/qu_bitcoin)
293
  - **Contact:** info@qbc.network