Add brains/sovereign-v3/README.md
Browse files
brains/sovereign-v3/README.md
CHANGED
|
@@ -11,8 +11,11 @@ TeacherV2/StudentV2 blueprint.
|
|
| 11 |
> behavior. Its real weapons: **return conditioning (RPO)**,
|
| 12 |
> **opponent-intent mirrors** and **one-step dynamics** (trained on
|
| 13 |
> labels the shards already contain), a **win-probability critic**, a
|
| 14 |
-
> **multi-scale attention cortex**,
|
| 15 |
-
>
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
---
|
| 18 |
|
|
@@ -20,10 +23,13 @@ TeacherV2/StudentV2 blueprint.
|
|
| 20 |
|
| 21 |
| File | What |
|
| 22 |
|---|---|
|
| 23 |
-
| `model.py` | the whole model, torch-only. Run `python model.py` for the CPU smoke test (
|
| 24 |
-
| `
|
| 25 |
-
| `
|
| 26 |
-
| `
|
|
|
|
|
|
|
|
|
|
| 27 |
| `sovereign_v3_init.pt` | optional random-init checkpoint (seed 0), exported by the upload script. |
|
| 28 |
|
| 29 |
## Input/output contract (the pipeline's fair-play rule)
|
|
|
|
| 11 |
> behavior. Its real weapons: **return conditioning (RPO)**,
|
| 12 |
> **opponent-intent mirrors** and **one-step dynamics** (trained on
|
| 13 |
> labels the shards already contain), a **win-probability critic**, a
|
| 14 |
+
> **multi-scale attention cortex**, an optional **GRU memory**, and now
|
| 15 |
+
> **MCTS planning over the learned dynamics** (search.py) with
|
| 16 |
+
> **league self-play** (league.py) and **wake-sleep distillation**
|
| 17 |
+
> (distill.py). It plans — with the honest caveats stated in
|
| 18 |
+
> search.py's docstring (fixed rollout pct, abstract latent).
|
| 19 |
|
| 20 |
---
|
| 21 |
|
|
|
|
| 23 |
|
| 24 |
| File | What |
|
| 25 |
|---|---|
|
| 26 |
+
| `model.py` | the whole model, torch-only (~290M incl. the MuZero-lite planning block). Run `python model.py` for the CPU smoke test (exact per-module params + shape checks). |
|
| 27 |
+
| `search.py` | MCTS planning (PUCT over the learned dynamics) — `python search.py` smoke-tests it. |
|
| 28 |
+
| `league.py` | league-lite self-play pool (frozen past selves, Elo, promotion). |
|
| 29 |
+
| `distill.py` | wake-sleep teacher→student distillation (+ search-target distillation). |
|
| 30 |
+
| `data_adapters.py` | shard → training samples: RTG, AWR weights, intent mirrors, next-frame labels, win labels, consecutive-frame dynamics targets. `python data_adapters.py` smoke-tests it. |
|
| 31 |
+
| `ARCHITECTURE.md` | design reasoning, module table, memory math, planning section, citations. |
|
| 32 |
+
| `train_notes.md` | the exact recipe: Stage A (return-conditioned BC + world model), Stage B (RPO + AlphaZero-lite visit distillation + league), Stage C (eval + wake-sleep), ablations, risks. |
|
| 33 |
| `sovereign_v3_init.pt` | optional random-init checkpoint (seed 0), exported by the upload script. |
|
| 34 |
|
| 35 |
## Input/output contract (the pipeline's fair-play rule)
|