onground commited on
Commit
4816c9b
·
verified ·
1 Parent(s): a5c9f59

Upload franka_multitask_v1/0020000/README.md with huggingface_hub

Browse files
franka_multitask_v1/0020000/README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Franka real-robot multi-task finetune — onground/ckpt
2
+
3
+ Resumed from `SeonghuJeon/oxe-mimicgen-all-h1to8-teacherdepth-300k`.
4
+ Architecture: DA3-Giant + Shallow12-AR predictor + ActionHeadV2
5
+ (`mlp_resnet`, `chunk_size=8`, `chunk_position_encoding=none`,
6
+ `pool_mode=mean`); T5-base language, concat conditioning; 2 RGB cameras.
7
+
8
+ ## What's in this upload
9
+
10
+ - `franka_multitask_v1/0020000/0020000.pt` — finetune checkpoint
11
+ - `franka_multitask_v1/0020000/config_resolved.yaml` — YAML the trainer logged
12
+ - `franka_multitask_v1/0020000/ds_config.json` — ZeRO-2 / mb=64 DeepSpeed config
13
+ - `franka_multitask_v1/0020000/franka_realrobot.json` — shared action stats
14
+ - `franka_multitask_v1/0020000/franka_realrobot_proprio.json` — shared proprio stats
15
+ - `franka_multitask_v1/0020000/metadata.json` — eval history + run metadata
16
+
17
+ ## Action / proprio / image convention
18
+
19
+ See `docs/realrobot-franka-deploy-handoff.md` in
20
+ [ONground-Korea/3DA](https://github.com/ONground-Korea/3DA) — it is the
21
+ single-file deploy entry point (literal task prompts, inverse mapping
22
+ pseudo-code, gripper polarity invert, gotchas). Companion training spec:
23
+ `docs/realrobot-finetune-franka.md`.
24
+
25
+ ## Eval history (held-out 41 episodes)
26
+
27
+ | step | l1_norm | l1_raw (m) | r2_norm | rel@5% | rel@10% |
28
+ |---|---|---|---|---|---|
29
+ | 12000 | 0.3096 | 0.0020 | 0.193 | 0.386 | 0.550 |
30
+ | 14000 | 0.3176 | 0.0022 | 0.185 | 0.371 | 0.542 |
31
+ | 16000 | 0.3158 | 0.0023 | 0.186 | 0.374 | 0.552 |
32
+ | 18000 | 0.3129 | 0.0020 | 0.186 | 0.374 | 0.552 |
33
+ | 20000 | 0.3118 | 0.0019 | 0.180 | 0.386 | 0.557 |
34
+
35
+ **Best by `l1_raw`: step 20000** (`0.0019 m`, `r2_norm=0.180`).