Upload franka_multitask_v1/0020000/README.md with huggingface_hub
Browse files
franka_multitask_v1/0020000/README.md
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Franka real-robot multi-task finetune — onground/ckpt
|
| 2 |
+
|
| 3 |
+
Resumed from `SeonghuJeon/oxe-mimicgen-all-h1to8-teacherdepth-300k`.
|
| 4 |
+
Architecture: DA3-Giant + Shallow12-AR predictor + ActionHeadV2
|
| 5 |
+
(`mlp_resnet`, `chunk_size=8`, `chunk_position_encoding=none`,
|
| 6 |
+
`pool_mode=mean`); T5-base language, concat conditioning; 2 RGB cameras.
|
| 7 |
+
|
| 8 |
+
## What's in this upload
|
| 9 |
+
|
| 10 |
+
- `franka_multitask_v1/0020000/0020000.pt` — finetune checkpoint
|
| 11 |
+
- `franka_multitask_v1/0020000/config_resolved.yaml` — YAML the trainer logged
|
| 12 |
+
- `franka_multitask_v1/0020000/ds_config.json` — ZeRO-2 / mb=64 DeepSpeed config
|
| 13 |
+
- `franka_multitask_v1/0020000/franka_realrobot.json` — shared action stats
|
| 14 |
+
- `franka_multitask_v1/0020000/franka_realrobot_proprio.json` — shared proprio stats
|
| 15 |
+
- `franka_multitask_v1/0020000/metadata.json` — eval history + run metadata
|
| 16 |
+
|
| 17 |
+
## Action / proprio / image convention
|
| 18 |
+
|
| 19 |
+
See `docs/realrobot-franka-deploy-handoff.md` in
|
| 20 |
+
[ONground-Korea/3DA](https://github.com/ONground-Korea/3DA) — it is the
|
| 21 |
+
single-file deploy entry point (literal task prompts, inverse mapping
|
| 22 |
+
pseudo-code, gripper polarity invert, gotchas). Companion training spec:
|
| 23 |
+
`docs/realrobot-finetune-franka.md`.
|
| 24 |
+
|
| 25 |
+
## Eval history (held-out 41 episodes)
|
| 26 |
+
|
| 27 |
+
| step | l1_norm | l1_raw (m) | r2_norm | rel@5% | rel@10% |
|
| 28 |
+
|---|---|---|---|---|---|
|
| 29 |
+
| 12000 | 0.3096 | 0.0020 | 0.193 | 0.386 | 0.550 |
|
| 30 |
+
| 14000 | 0.3176 | 0.0022 | 0.185 | 0.371 | 0.542 |
|
| 31 |
+
| 16000 | 0.3158 | 0.0023 | 0.186 | 0.374 | 0.552 |
|
| 32 |
+
| 18000 | 0.3129 | 0.0020 | 0.186 | 0.374 | 0.552 |
|
| 33 |
+
| 20000 | 0.3118 | 0.0019 | 0.180 | 0.386 | 0.557 |
|
| 34 |
+
|
| 35 |
+
**Best by `l1_raw`: step 20000** (`0.0019 m`, `r2_norm=0.180`).
|