Instructions to use Dimios45/yam-world-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use Dimios45/yam-world-model with LeRobot:
- Notebooks
- Google Colab
- Kaggle
Document abc12 ABC-130k model: capacity result and action-conditioning failure
Browse files
README.md
CHANGED
|
@@ -160,6 +160,31 @@ training as ABC's dense two-arm scenes saturated the 96-latent bottleneck.
|
|
| 160 |
**The weights published here are the single-corpus YAM model, which passes the
|
| 161 |
action control.**
|
| 162 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 163 |
## Reproducing
|
| 164 |
|
| 165 |
Full recipe, per-stage commands, and the failure modes encountered are documented
|
|
|
|
| 160 |
**The weights published here are the single-corpus YAM model, which passes the
|
| 161 |
action control.**
|
| 162 |
|
| 163 |
+
## Also in this repo: `abc12/` — an ABC-130k bimanual model
|
| 164 |
+
|
| 165 |
+
A second pair of checkpoints trained from scratch on **ABC-130k** (240 episodes
|
| 166 |
+
across 48 tasks, streamed from a 33.75 TB Rerun bucket without bulk downloading).
|
| 167 |
+
Larger tokenizer: **192 latents x 24 channels**.
|
| 168 |
+
|
| 169 |
+
| | |
|
| 170 |
+
| --- | --- |
|
| 171 |
+
| `abc12/tokenizer` | 24k steps, **28.31 dB** held-out reconstruction |
|
| 172 |
+
| `abc12/dynamics` | 16k steps, EMA rollout 19.10 dB |
|
| 173 |
+
|
| 174 |
+
**Doubling bottleneck width lifted reconstruction 22.90 -> 28.31 dB** on identical
|
| 175 |
+
eval clips — a decisive answer to whether ABC's dense two-arm scenes were
|
| 176 |
+
capacity-limited. They were.
|
| 177 |
+
|
| 178 |
+
**It did not produce action-conditioning.** Feeding another episode's actions
|
| 179 |
+
yields motion *closer* to ground truth than the true actions (2.34x vs 3.12x of
|
| 180 |
+
ground-truth motion), so the model is not following its commands. Rollouts sit at
|
| 181 |
+
17.02 dB against a 28.31 dB tokenizer ceiling — the dynamics model, not the
|
| 182 |
+
tokenizer, is the binding constraint. Full analysis in
|
| 183 |
+
[`docs/abc130k_world_model.md`](https://github.com/Dimios45/visionary/blob/main/docs/abc130k_world_model.md).
|
| 184 |
+
|
| 185 |
+
**Use `abc12/` for bimanual reconstruction; use the YAM weights above if you need a
|
| 186 |
+
world model that responds to actions.**
|
| 187 |
+
|
| 188 |
## Reproducing
|
| 189 |
|
| 190 |
Full recipe, per-stage commands, and the failure modes encountered are documented
|