weepiess2383 commited on
Commit
9c9c626
·
verified ·
1 Parent(s): 17b8bfc

README: contents, provenance and recorded LIBERO results

Browse files
Files changed (1) hide show
  1. README.md +67 -0
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - robotics
5
+ - vla
6
+ - libero
7
+ ---
8
+
9
+ # arc-layermap-ft
10
+
11
+ Archived **EMA-only** weights for the layer-map LIBERO finetunes (`m323` protocol):
12
+ the full-layer full-FT arm, the first-28 full-FT arm, and the first-28 frozen arm.
13
+ Full checkpoint directories (32–44 GiB/step, optimizer state included) were deleted
14
+ from the cluster after this upload verified.
15
+
16
+ ## What each file is
17
+
18
+ ```
19
+ <run_dir>/config.yaml training config
20
+ <run_dir>/dataset_stats.json normalizer stats
21
+ <run_dir>/<ckpt>.ckpt.shards.step0000NNNNN/state.pt EMA weights ONLY
22
+ <run_dir>/<ckpt>.ckpt.shards.step0000NNNNN/engine_meta.pt
23
+ ```
24
+
25
+ `state.pt` holds `{"extra": {"ema": {name -> fp32 CPU tensor}}}`, the payload
26
+ `methods/lafm/vla_flow_ft.py:load_pretrain_trainables()` reads. Load with
27
+ **`model.init_use_ema=true`**. No `"model"` key, no optimizer state — **init / eval
28
+ only, not resumable**. Each `engine_meta.pt` is the original and its
29
+ `ema_fingerprint` matches the archived tensors (rel < 1e-6).
30
+
31
+ Note the frozen run archives only its trainable set;
32
+ the two full-FT runs carry the whole trunk.
33
+
34
+ ## Contents
35
+
36
+ | run dir | step | EMA tensors | params | LIBERO | why this step |
37
+ |---|---|---|---|---|---|
38
+ | `lafm_vla_flow_neo2b_fulllayer_libero_fullft_m323_flft0815r` | `step000020000` | 1049 | 2.92 B | **94.80** | grid peak |
39
+ | `lafm_vla_flow_neo2b_first28_libero_fullft_m323_f28ft0811` | `step000017500` | 737 | 2.13 B | **94.55** | grid peak |
40
+ | `lafm_vla_flow_neo2b_first28_libero_fullft_m323_f28ft0811` | `step000020000` | 737 | 2.13 B | 94.25 | originally requested |
41
+ | `lafm_vla_flow_neo2b_first28_libero_m323_f28ft0811` | `step000030000` | 376 | 0.44 B | **93.15** | grid peak and last step |
42
+
43
+ Full 4-suite LIBERO (spatial / object / goal / long; 10 tasks x 50 trials x 4 =
44
+ 2000 rollouts per point), **m323** decode: replan 4, action horizon 8, NFE 10,
45
+ no control_rate, `use_ema: true`, render 256, pinned mujoco 3.2.3 / robosuite 1.4.1.
46
+ Single seed per point.
47
+
48
+ **Do not compare these against the GEO or camera-mode archives** — those use the
49
+ NA12 decode protocol (replan 12 / horizon 20 / control_rate 20) and the two
50
+ protocols are not interchangeable.
51
+
52
+ Two step choices deserve a note:
53
+
54
+ - **first-28 full-FT** — the peak is 94.55 at **step000017500**, not at 20000
55
+ (94.25). Both are archived so the peak is not lost.
56
+ - **first-28 frozen** — 93.15 at step000030000 is both the best and the last step.
57
+ An earlier internal note quoting "92.8" is stale: it is the rounded 92.75 at
58
+ step 5000, recorded while the grid still stopped at 17500.
59
+
60
+ ## Not included
61
+
62
+ Only the steps above are archived; every other grid step was deleted and is **not**
63
+ recoverable. Single-seed grid curves for the record (steps 2500 → 30000 by 2500):
64
+
65
+ - fulllayer full-FT: 89.80 / 93.35 / 94.35 / 94.25 / 93.30 / 94.20 / 94.20 / **94.80** / 94.45 / 94.55 / *(27500 and 30000 were never evaluated)*
66
+ - first-28 full-FT: 89.35 / 94.50 / 93.50 / 94.25 / 93.65 / 94.50 / **94.55** / 94.25 / 92.90 / 93.50 / 93.75 / 93.30
67
+ - first-28 frozen: 85.80 / 92.75 / 91.75 / 92.45 / 92.45 / 92.15 / 91.85 / 92.65 / 92.05 / 92.25 / 92.25 / **93.15**