Document task10_coffee_station_29999
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ tags:
|
|
| 6 |
base_model: IliaLarchenko/behavior_50t_checkpoint
|
| 7 |
---
|
| 8 |
|
| 9 |
-
# b1k
|
| 10 |
|
| 11 |
Params-only checkpoints for offline evaluation. `train_state` is **not** included, so these
|
| 12 |
cannot be resumed from — inference/eval only.
|
|
@@ -27,6 +27,41 @@ using the **200 human demonstrations** from the 2026 BEHAVIOR-1K challenge set a
|
|
| 27 |
| task space | `B1K_TASK_SPACE=100`; `setting_mousetraps` is index 5 in both the 2025 and 2026 tables, so its task/stage embeddings are **pretrained**, not randomly initialised |
|
| 28 |
| final logged | `action_loss = 0.0209` at step 21,775 |
|
| 29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
### Reading the loss
|
| 31 |
|
| 32 |
`action_loss` here is **training-set** loss. There is no validation split and no rollout
|
|
|
|
| 6 |
base_model: IliaLarchenko/behavior_50t_checkpoint
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# b1k single-task checkpoints
|
| 10 |
|
| 11 |
Params-only checkpoints for offline evaluation. `train_state` is **not** included, so these
|
| 12 |
cannot be resumed from — inference/eval only.
|
|
|
|
| 27 |
| task space | `B1K_TASK_SPACE=100`; `setting_mousetraps` is index 5 in both the 2025 and 2026 tables, so its task/stage embeddings are **pretrained**, not randomly initialised |
|
| 28 |
| final logged | `action_loss = 0.0209` at step 21,775 |
|
| 29 |
|
| 30 |
+
## `task10_coffee_station_29999`
|
| 31 |
+
|
| 32 |
+
Single-task fine-tune of the 50-task meta checkpoint on **task 10 =
|
| 33 |
+
`set_up_a_coffee_station_in_your_kitchen`**, using the **200 human demonstrations** from the
|
| 34 |
+
2026 BEHAVIOR-1K challenge set and nothing else. Run completed in full.
|
| 35 |
+
|
| 36 |
+
| | |
|
| 37 |
+
|---|---|
|
| 38 |
+
| init | `IliaLarchenko/behavior_50t_checkpoint` (params) |
|
| 39 |
+
| data | `2026-challenge-demos-224`, activity `set_up_a_coffee_station_in_your_kitchen`, 200 episodes / 1,253,243 frames |
|
| 40 |
+
| step | 29,999 of 30,000 (**completed**, 16 h 54 m on 8× H200) |
|
| 41 |
+
| batch | 256 (32/GPU × 8× H200), FSDP over 8 devices |
|
| 42 |
+
| LR | **flat 5e-6** — `init = peak = decay = 5e-6`, so no warmup ramp and no cosine decay |
|
| 43 |
+
| norm stats | 2025 stats with the robot-frame `base_qvel` correction on state dims 0–2 (same `qvelfix` stats as the task-5 runs) |
|
| 44 |
+
| task space | `B1K_TASK_SPACE=100`; `set_up_a_coffee_station_in_your_kitchen` is index 10 in both the 2025 and 2026 tables, so its task/stage embeddings are **pretrained**, not randomly initialised |
|
| 45 |
+
| final logged | `action_loss = 0.0294`, `total_loss = 0.0565`, `fast_accuracy = 0.8208` at step 29,975 |
|
| 46 |
+
|
| 47 |
+
Because the LR is flat with no annealing, the final step is **not** necessarily the best
|
| 48 |
+
checkpoint — there is no decay phase to settle into a minimum. Steps 4000/8000/.../28000 were
|
| 49 |
+
retained locally and can be uploaded if you want to sweep across them.
|
| 50 |
+
|
| 51 |
+
### Video encoding caveat for this checkpoint
|
| 52 |
+
|
| 53 |
+
Trained on the `2026-challenge-demos-224` build, whose bitstream reports **x264 `crf=20.0`,
|
| 54 |
+
`keyint=250`**. Measured against `b1k-224x224-gop8-fixed` (x265 `crf=28.0`, `keyint=8`) on
|
| 55 |
+
identical frames, this build is slightly softer: **0.886× Laplacian variance, 0.933× HF
|
| 56 |
+
spectral energy**. The downscaling filter is not recorded in the bitstream and is unverified.
|
| 57 |
+
No task-success delta has been measured for this difference — it is an input-statistics
|
| 58 |
+
observation only.
|
| 59 |
+
|
| 60 |
+
One video file in the source data (`right_realsense .../chunk-010/file-002.mp4`, backing 46 of
|
| 61 |
+
the 200 episodes) had no moov atom and was unreadable; it was re-encoded from the intact
|
| 62 |
+
480×480 HEVC original at x264 CRF 23 / GOP 250 to match its neighbours, verified at 43–50 dB
|
| 63 |
+
PSNR against the source.
|
| 64 |
+
|
| 65 |
### Reading the loss
|
| 66 |
|
| 67 |
`action_loss` here is **training-set** loss. There is no validation split and no rollout
|