amer224 commited on
Commit
1a9ef06
·
verified ·
1 Parent(s): 2386f40

Add brains/sovereign-nano/nano_notes.md

Browse files
Files changed (1) hide show
  1. brains/sovereign-nano/nano_notes.md +20 -0
brains/sovereign-nano/nano_notes.md CHANGED
@@ -231,3 +231,23 @@ integrated version:
231
  - Pool 25.3 GB, reviewed 22.2 GB climbing; fleet + watchdog alive.
232
  - B's gates: GPU = training only; nano --ckpt eval ready the moment a
233
  distilled nano is uploaded.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
231
  - Pool 25.3 GB, reviewed 22.2 GB climbing; fleet + watchdog alive.
232
  - B's gates: GPU = training only; nano --ckpt eval ready the moment a
233
  distilled nano is uploaded.
234
+
235
+ ## 12. 17-Aug ~13:20Z update (B's relay)
236
+
237
+ - **v9 step-82: cell_nll 6.258 (kind 1.51)** — the 0.1× tower-final init
238
+ + label smoothing is verified at 290M scale (v8 was 36.2 at step 300).
239
+ 6.258 is already BELOW the smoothed uniform floor ≈6.93: the gate
240
+ brain is learning the farmer's click structure, not merely
241
+ well-initialized. The init fix recovered ~85% of the cell-loss budget
242
+ that PPO would otherwise have had to burn.
243
+ - **FULL MODE (60 GPU-h/wk)**: two parallel Stage-A arms —
244
+ `sovereign-gpu` = standard weights (survivor ×4 / kill ×2);
245
+ `sovereign-gpu-b` = survivor ×2 / kill ×4 ablation. The winner of the
246
+ identical-seed evals becomes the distill teacher. Decision protocol
247
+ (proposed, for auditability): rank primary, wr tiebreak (rank delta
248
+ <0.1 = tie), cell_nll health-only; both within 0.2 rank → standard
249
+ arm wins. Interpretation: ×4/×2 winning = survival streaks are the
250
+ signal; ×2/×4 winning = kill windows are the signal.
251
+ - **--tiny verified on B's 2 GB box**: exit 0, cell_nll 8.37, full
252
+ chain — the no_grad+mmap diagnosis was exact. Finding 2 closed.
253
+ - §10 distill recipe armed; fires the moment best.json moves.