fastwalker1118 commited on
Commit
a123db3
·
verified ·
1 Parent(s): 62131d9

Document task10_coffee_station_29999

Browse files
Files changed (1) hide show
  1. README.md +36 -1
README.md CHANGED
@@ -6,7 +6,7 @@ tags:
6
  base_model: IliaLarchenko/behavior_50t_checkpoint
7
  ---
8
 
9
- # b1k task-5 checkpoints (`setting_mousetraps`)
10
 
11
  Params-only checkpoints for offline evaluation. `train_state` is **not** included, so these
12
  cannot be resumed from — inference/eval only.
@@ -27,6 +27,41 @@ using the **200 human demonstrations** from the 2026 BEHAVIOR-1K challenge set a
27
  | task space | `B1K_TASK_SPACE=100`; `setting_mousetraps` is index 5 in both the 2025 and 2026 tables, so its task/stage embeddings are **pretrained**, not randomly initialised |
28
  | final logged | `action_loss = 0.0209` at step 21,775 |
29
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ### Reading the loss
31
 
32
  `action_loss` here is **training-set** loss. There is no validation split and no rollout
 
6
  base_model: IliaLarchenko/behavior_50t_checkpoint
7
  ---
8
 
9
+ # b1k single-task checkpoints
10
 
11
  Params-only checkpoints for offline evaluation. `train_state` is **not** included, so these
12
  cannot be resumed from — inference/eval only.
 
27
  | task space | `B1K_TASK_SPACE=100`; `setting_mousetraps` is index 5 in both the 2025 and 2026 tables, so its task/stage embeddings are **pretrained**, not randomly initialised |
28
  | final logged | `action_loss = 0.0209` at step 21,775 |
29
 
30
+ ## `task10_coffee_station_29999`
31
+
32
+ Single-task fine-tune of the 50-task meta checkpoint on **task 10 =
33
+ `set_up_a_coffee_station_in_your_kitchen`**, using the **200 human demonstrations** from the
34
+ 2026 BEHAVIOR-1K challenge set and nothing else. Run completed in full.
35
+
36
+ | | |
37
+ |---|---|
38
+ | init | `IliaLarchenko/behavior_50t_checkpoint` (params) |
39
+ | data | `2026-challenge-demos-224`, activity `set_up_a_coffee_station_in_your_kitchen`, 200 episodes / 1,253,243 frames |
40
+ | step | 29,999 of 30,000 (**completed**, 16 h 54 m on 8× H200) |
41
+ | batch | 256 (32/GPU × 8× H200), FSDP over 8 devices |
42
+ | LR | **flat 5e-6** — `init = peak = decay = 5e-6`, so no warmup ramp and no cosine decay |
43
+ | norm stats | 2025 stats with the robot-frame `base_qvel` correction on state dims 0–2 (same `qvelfix` stats as the task-5 runs) |
44
+ | task space | `B1K_TASK_SPACE=100`; `set_up_a_coffee_station_in_your_kitchen` is index 10 in both the 2025 and 2026 tables, so its task/stage embeddings are **pretrained**, not randomly initialised |
45
+ | final logged | `action_loss = 0.0294`, `total_loss = 0.0565`, `fast_accuracy = 0.8208` at step 29,975 |
46
+
47
+ Because the LR is flat with no annealing, the final step is **not** necessarily the best
48
+ checkpoint — there is no decay phase to settle into a minimum. Steps 4000/8000/.../28000 were
49
+ retained locally and can be uploaded if you want to sweep across them.
50
+
51
+ ### Video encoding caveat for this checkpoint
52
+
53
+ Trained on the `2026-challenge-demos-224` build, whose bitstream reports **x264 `crf=20.0`,
54
+ `keyint=250`**. Measured against `b1k-224x224-gop8-fixed` (x265 `crf=28.0`, `keyint=8`) on
55
+ identical frames, this build is slightly softer: **0.886× Laplacian variance, 0.933× HF
56
+ spectral energy**. The downscaling filter is not recorded in the bitstream and is unverified.
57
+ No task-success delta has been measured for this difference — it is an input-statistics
58
+ observation only.
59
+
60
+ One video file in the source data (`right_realsense .../chunk-010/file-002.mp4`, backing 46 of
61
+ the 200 episodes) had no moov atom and was unreadable; it was re-encoded from the intact
62
+ 480×480 HEVC original at x264 CRF 23 / GOP 250 to match its neighbours, verified at 43–50 dB
63
+ PSNR against the source.
64
+
65
  ### Reading the loss
66
 
67
  `action_loss` here is **training-set** loss. There is no validation split and no rollout