README: contents, provenance and recorded LIBERO results
Browse files
README.md
ADDED
|
@@ -0,0 +1,67 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- robotics
|
| 5 |
+
- vla
|
| 6 |
+
- libero
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# arc-layermap-ft
|
| 10 |
+
|
| 11 |
+
Archived **EMA-only** weights for the layer-map LIBERO finetunes (`m323` protocol):
|
| 12 |
+
the full-layer full-FT arm, the first-28 full-FT arm, and the first-28 frozen arm.
|
| 13 |
+
Full checkpoint directories (32–44 GiB/step, optimizer state included) were deleted
|
| 14 |
+
from the cluster after this upload verified.
|
| 15 |
+
|
| 16 |
+
## What each file is
|
| 17 |
+
|
| 18 |
+
```
|
| 19 |
+
<run_dir>/config.yaml training config
|
| 20 |
+
<run_dir>/dataset_stats.json normalizer stats
|
| 21 |
+
<run_dir>/<ckpt>.ckpt.shards.step0000NNNNN/state.pt EMA weights ONLY
|
| 22 |
+
<run_dir>/<ckpt>.ckpt.shards.step0000NNNNN/engine_meta.pt
|
| 23 |
+
```
|
| 24 |
+
|
| 25 |
+
`state.pt` holds `{"extra": {"ema": {name -> fp32 CPU tensor}}}`, the payload
|
| 26 |
+
`methods/lafm/vla_flow_ft.py:load_pretrain_trainables()` reads. Load with
|
| 27 |
+
**`model.init_use_ema=true`**. No `"model"` key, no optimizer state — **init / eval
|
| 28 |
+
only, not resumable**. Each `engine_meta.pt` is the original and its
|
| 29 |
+
`ema_fingerprint` matches the archived tensors (rel < 1e-6).
|
| 30 |
+
|
| 31 |
+
Note the frozen run archives only its trainable set;
|
| 32 |
+
the two full-FT runs carry the whole trunk.
|
| 33 |
+
|
| 34 |
+
## Contents
|
| 35 |
+
|
| 36 |
+
| run dir | step | EMA tensors | params | LIBERO | why this step |
|
| 37 |
+
|---|---|---|---|---|---|
|
| 38 |
+
| `lafm_vla_flow_neo2b_fulllayer_libero_fullft_m323_flft0815r` | `step000020000` | 1049 | 2.92 B | **94.80** | grid peak |
|
| 39 |
+
| `lafm_vla_flow_neo2b_first28_libero_fullft_m323_f28ft0811` | `step000017500` | 737 | 2.13 B | **94.55** | grid peak |
|
| 40 |
+
| `lafm_vla_flow_neo2b_first28_libero_fullft_m323_f28ft0811` | `step000020000` | 737 | 2.13 B | 94.25 | originally requested |
|
| 41 |
+
| `lafm_vla_flow_neo2b_first28_libero_m323_f28ft0811` | `step000030000` | 376 | 0.44 B | **93.15** | grid peak and last step |
|
| 42 |
+
|
| 43 |
+
Full 4-suite LIBERO (spatial / object / goal / long; 10 tasks x 50 trials x 4 =
|
| 44 |
+
2000 rollouts per point), **m323** decode: replan 4, action horizon 8, NFE 10,
|
| 45 |
+
no control_rate, `use_ema: true`, render 256, pinned mujoco 3.2.3 / robosuite 1.4.1.
|
| 46 |
+
Single seed per point.
|
| 47 |
+
|
| 48 |
+
**Do not compare these against the GEO or camera-mode archives** — those use the
|
| 49 |
+
NA12 decode protocol (replan 12 / horizon 20 / control_rate 20) and the two
|
| 50 |
+
protocols are not interchangeable.
|
| 51 |
+
|
| 52 |
+
Two step choices deserve a note:
|
| 53 |
+
|
| 54 |
+
- **first-28 full-FT** — the peak is 94.55 at **step000017500**, not at 20000
|
| 55 |
+
(94.25). Both are archived so the peak is not lost.
|
| 56 |
+
- **first-28 frozen** — 93.15 at step000030000 is both the best and the last step.
|
| 57 |
+
An earlier internal note quoting "92.8" is stale: it is the rounded 92.75 at
|
| 58 |
+
step 5000, recorded while the grid still stopped at 17500.
|
| 59 |
+
|
| 60 |
+
## Not included
|
| 61 |
+
|
| 62 |
+
Only the steps above are archived; every other grid step was deleted and is **not**
|
| 63 |
+
recoverable. Single-seed grid curves for the record (steps 2500 → 30000 by 2500):
|
| 64 |
+
|
| 65 |
+
- fulllayer full-FT: 89.80 / 93.35 / 94.35 / 94.25 / 93.30 / 94.20 / 94.20 / **94.80** / 94.45 / 94.55 / *(27500 and 30000 were never evaluated)*
|
| 66 |
+
- first-28 full-FT: 89.35 / 94.50 / 93.50 / 94.25 / 93.65 / 94.50 / **94.55** / 94.25 / 92.90 / 93.50 / 93.75 / 93.30
|
| 67 |
+
- first-28 frozen: 85.80 / 92.75 / 91.75 / 92.45 / 92.45 / 92.15 / 91.85 / 92.65 / 92.05 / 92.25 / 92.25 / **93.15**
|