Add brains/sovereign-nano/nano_notes.md
Browse files
brains/sovereign-nano/nano_notes.md
CHANGED
|
@@ -231,3 +231,23 @@ integrated version:
|
|
| 231 |
- Pool 25.3 GB, reviewed 22.2 GB climbing; fleet + watchdog alive.
|
| 232 |
- B's gates: GPU = training only; nano --ckpt eval ready the moment a
|
| 233 |
distilled nano is uploaded.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 231 |
- Pool 25.3 GB, reviewed 22.2 GB climbing; fleet + watchdog alive.
|
| 232 |
- B's gates: GPU = training only; nano --ckpt eval ready the moment a
|
| 233 |
distilled nano is uploaded.
|
| 234 |
+
|
| 235 |
+
## 12. 17-Aug ~13:20Z update (B's relay)
|
| 236 |
+
|
| 237 |
+
- **v9 step-82: cell_nll 6.258 (kind 1.51)** — the 0.1× tower-final init
|
| 238 |
+
+ label smoothing is verified at 290M scale (v8 was 36.2 at step 300).
|
| 239 |
+
6.258 is already BELOW the smoothed uniform floor ≈6.93: the gate
|
| 240 |
+
brain is learning the farmer's click structure, not merely
|
| 241 |
+
well-initialized. The init fix recovered ~85% of the cell-loss budget
|
| 242 |
+
that PPO would otherwise have had to burn.
|
| 243 |
+
- **FULL MODE (60 GPU-h/wk)**: two parallel Stage-A arms —
|
| 244 |
+
`sovereign-gpu` = standard weights (survivor ×4 / kill ×2);
|
| 245 |
+
`sovereign-gpu-b` = survivor ×2 / kill ×4 ablation. The winner of the
|
| 246 |
+
identical-seed evals becomes the distill teacher. Decision protocol
|
| 247 |
+
(proposed, for auditability): rank primary, wr tiebreak (rank delta
|
| 248 |
+
<0.1 = tie), cell_nll health-only; both within 0.2 rank → standard
|
| 249 |
+
arm wins. Interpretation: ×4/×2 winning = survival streaks are the
|
| 250 |
+
signal; ×2/×4 winning = kill windows are the signal.
|
| 251 |
+
- **--tiny verified on B's 2 GB box**: exit 0, cell_nll 8.37, full
|
| 252 |
+
chain — the no_grad+mmap diagnosis was exact. Finding 2 closed.
|
| 253 |
+
- §10 distill recipe armed; fires the moment best.json moves.
|