Dimios45 commited on
Commit
fb41d69
·
verified ·
1 Parent(s): c4ac903

Document abc12 ABC-130k model: capacity result and action-conditioning failure

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md CHANGED
@@ -160,6 +160,31 @@ training as ABC's dense two-arm scenes saturated the 96-latent bottleneck.
160
  **The weights published here are the single-corpus YAM model, which passes the
161
  action control.**
162
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
163
  ## Reproducing
164
 
165
  Full recipe, per-stage commands, and the failure modes encountered are documented
 
160
  **The weights published here are the single-corpus YAM model, which passes the
161
  action control.**
162
 
163
+ ## Also in this repo: `abc12/` — an ABC-130k bimanual model
164
+
165
+ A second pair of checkpoints trained from scratch on **ABC-130k** (240 episodes
166
+ across 48 tasks, streamed from a 33.75 TB Rerun bucket without bulk downloading).
167
+ Larger tokenizer: **192 latents x 24 channels**.
168
+
169
+ | | |
170
+ | --- | --- |
171
+ | `abc12/tokenizer` | 24k steps, **28.31 dB** held-out reconstruction |
172
+ | `abc12/dynamics` | 16k steps, EMA rollout 19.10 dB |
173
+
174
+ **Doubling bottleneck width lifted reconstruction 22.90 -> 28.31 dB** on identical
175
+ eval clips — a decisive answer to whether ABC's dense two-arm scenes were
176
+ capacity-limited. They were.
177
+
178
+ **It did not produce action-conditioning.** Feeding another episode's actions
179
+ yields motion *closer* to ground truth than the true actions (2.34x vs 3.12x of
180
+ ground-truth motion), so the model is not following its commands. Rollouts sit at
181
+ 17.02 dB against a 28.31 dB tokenizer ceiling — the dynamics model, not the
182
+ tokenizer, is the binding constraint. Full analysis in
183
+ [`docs/abc130k_world_model.md`](https://github.com/Dimios45/visionary/blob/main/docs/abc130k_world_model.md).
184
+
185
+ **Use `abc12/` for bimanual reconstruction; use the YAM weights above if you need a
186
+ world model that responds to actions.**
187
+
188
  ## Reproducing
189
 
190
  Full recipe, per-stage commands, and the failure modes encountered are documented