legacy: add index of archived experimental checkpoints
Browse files- legacy/README.md +109 -0
legacy/README.md
ADDED
|
@@ -0,0 +1,109 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# `legacy/` — archived experimental checkpoints
|
| 2 |
+
|
| 3 |
+
Superseded runs, kept for reference. Archived **2026-08-11**; nothing here is deleted,
|
| 4 |
+
only moved out of the repo root so the active models are easy to find.
|
| 5 |
+
|
| 6 |
+
**These are exploratory spatial-branch experiments, mostly single-task (task 12 / task 31
|
| 7 |
+
boxing gloves / clean-up-your-desk).** For anything you actually want to run, use the
|
| 8 |
+
folders at the repo root instead — see [Active models](#active-models-at-the-repo-root).
|
| 9 |
+
|
| 10 |
+
Total: **13 folders, 793 files, 173.6 GiB.**
|
| 11 |
+
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
## What is in here
|
| 15 |
+
|
| 16 |
+
### `kvsplit_*` — K/V-split DA3 bank
|
| 17 |
+
|
| 18 |
+
The DA3 spatial-bank redesign where bank **keys** carry only the address (position +
|
| 19 |
+
Plücker ray + view index) and **values** carry only the payload, instead of both being
|
| 20 |
+
projections of the same concatenated feature.
|
| 21 |
+
|
| 22 |
+
| folder | size |
|
| 23 |
+
|---|---|
|
| 24 |
+
| `kvsplit_newbank_step39999` | 14.10 GiB |
|
| 25 |
+
| `kvsplit_spatretrain_step12000` | 13.23 GiB |
|
| 26 |
+
| `kvsplit_spatretrain_step18000` | 13.23 GiB |
|
| 27 |
+
| `kvsplit_spatretrain_step19999` | 13.23 GiB |
|
| 28 |
+
| `kvsplit_strongbase_step14999` | 13.23 GiB |
|
| 29 |
+
|
| 30 |
+
`spatretrain` is one run captured at three steps — 12000, 18000 and 19999. Per its
|
| 31 |
+
original commit message, **step 18000 was the best of the three** (loss ≈ 0.115), so 19999
|
| 32 |
+
is not automatically the one to reach for.
|
| 33 |
+
|
| 34 |
+
### `task12_da3_*` — task-12 DA3 ablations
|
| 35 |
+
|
| 36 |
+
Same task, varying the depth backbone (`giant` vs `large`), the geometry representation
|
| 37 |
+
(`gtdepth` vs `pointmap`), and the LR treatment of the base model (`1p5x`, `slowbase`).
|
| 38 |
+
|
| 39 |
+
| folder | size |
|
| 40 |
+
|---|---|
|
| 41 |
+
| `task12_da3_giant_gtdepth_v2_1p5x_step19999` | 13.33 GiB |
|
| 42 |
+
| `task12_da3_large_gtdepth_newbank_step19999` | 13.32 GiB |
|
| 43 |
+
| `task12_da3_large_gtdepth_v2_1p5x_slowbase_step19999` | 13.33 GiB |
|
| 44 |
+
| `task12_da3_large_gtdepth_v2_pointmap_step19999` | 13.32 GiB |
|
| 45 |
+
| `task12_da3_large_gtdepth_v2_pointmap_step29999_ext30k` | 13.32 GiB |
|
| 46 |
+
|
| 47 |
+
`..._pointmap_step29999_ext30k` is the 30k-step extension of the 20k `..._pointmap_step19999`
|
| 48 |
+
run, not an independent experiment.
|
| 49 |
+
|
| 50 |
+
### `vggt_*` — VGGT spatial backbone
|
| 51 |
+
|
| 52 |
+
The alternative to DA3: VGGT as the geometry encoder, on the boxing-gloves task.
|
| 53 |
+
|
| 54 |
+
| folder | size |
|
| 55 |
+
|---|---|
|
| 56 |
+
| `vggt_newbank_boxing_gloves_step19999` | 13.34 GiB |
|
| 57 |
+
| `vggt_newbank_boxing_gloves_step8000` | 13.34 GiB |
|
| 58 |
+
|
| 59 |
+
### `pi05_da3_freezebase_desk_step8000` — 13.23 GiB
|
| 60 |
+
|
| 61 |
+
DA3 with the base policy frozen, on `clean_up_your_desk`. An early spatial-branch probe.
|
| 62 |
+
|
| 63 |
+
---
|
| 64 |
+
|
| 65 |
+
## Active models, at the repo root
|
| 66 |
+
|
| 67 |
+
| folder | what |
|
| 68 |
+
|---|---|
|
| 69 |
+
| `meta5_2026_224/` | 5-task meta-training — the root `README.md` documents this one |
|
| 70 |
+
| `meta5_2026_224_ext/` | extension of the above past 20k steps |
|
| 71 |
+
| `task77_installing_a_modem/` | single-task fine-tune, with `README.md` + `EVAL.md` |
|
| 72 |
+
| `task85_putting_dirty_dishes_in_sink/` | single-task fine-tune, with `README.md` + `EVAL.md` |
|
| 73 |
+
| `single-task-finetune-0807/` | five single-task fine-tunes: `turning_on_radio`, `setting_mousetraps`, `make_microwave_popcorn`, `dispose_of_glass`, `installing_a_modem` |
|
| 74 |
+
| `task31_clean_boxing_gloves_pi05_baseline_20k_step19999_params_only/` | no-DA3 baseline for the boxing-gloves task — the control the `vggt_*` runs in here were compared against |
|
| 75 |
+
| `pibehavior_da3_clean_up_your_desk_40k/` | 40k-step DA3 run on `clean_up_your_desk` |
|
| 76 |
+
| `bringing_in_wood_20k/`, `can_meat_20k/`, `can_meat_30k/`, `chop_an_onion_20k/`, `clean_up_your_desk_20k/` | earlier single-task runs |
|
| 77 |
+
| `da3-newbank/` | DA3 spatial-branch weights only (0.8 GiB), not a full policy |
|
| 78 |
+
| `norm-stats-fixed/` | standalone corrected `norm_stats.json` (robot-frame `base_qvel`) |
|
| 79 |
+
|
| 80 |
+
`EVAL.md` (identical in `task77_*` and `task85_*`) is the shared eval contract — observation
|
| 81 |
+
layout, wrapper behaviour, the full loop — and applies to every checkpoint in the repo.
|
| 82 |
+
|
| 83 |
+
---
|
| 84 |
+
|
| 85 |
+
## Before you use anything in here
|
| 86 |
+
|
| 87 |
+
1. **Use each checkpoint's own bundled `assets/`.** Every folder ships its own
|
| 88 |
+
`assets/IliaLarchenko/behavior_224_rgb/norm_stats.json` and `fast_tokenizer/`. Do not
|
| 89 |
+
share one set across models, and do not substitute `norm-stats-fixed/` into these — all
|
| 90 |
+
of these runs predate the `base_qvel` correction and their weights adapted to the 2025
|
| 91 |
+
world-frame statistics. Swapping in the corrected file would put state dims 0:3 roughly
|
| 92 |
+
an order of magnitude off the scale they were trained on.
|
| 93 |
+
|
| 94 |
+
2. **Loss values are not comparable across folders.** Different tasks, different step
|
| 95 |
+
counts, and episode length varies several-fold between tasks.
|
| 96 |
+
|
| 97 |
+
3. **These need the DA3 (or VGGT) spatial branch wired in** — they are not stock
|
| 98 |
+
PiBehavior and will not load into a plain π0.5 eval path.
|
| 99 |
+
|
| 100 |
+
4. **Training-set metrics only.** No validation split, no rollout evaluation.
|
| 101 |
+
|
| 102 |
+
---
|
| 103 |
+
|
| 104 |
+
## Note on how these were moved
|
| 105 |
+
|
| 106 |
+
Moved with the Hub API, not re-uploaded: LFS blobs were copied server-side by reference,
|
| 107 |
+
so the 173.6 GiB never left the Hub. Every one of the 793 files was verified identical at
|
| 108 |
+
the destination (LFS `sha256` for params, git blob id for the rest) *before* the originals
|
| 109 |
+
were deleted. Original upload dates are recoverable from the repo's commit history.
|