businesslion commited on
Commit
c2e052d
·
0 Parent(s):

HapticWAM release (arXiv:2609.23888)

Browse files
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: pytorch
4
+ tags:
5
+ - robotics
6
+ - tactile
7
+ - manipulation
8
+ - world-model
9
+ pipeline_tag: robotics
10
+ ---
11
+
12
+ # HapticWAM teacher
13
+
14
+ > **HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing**
15
+ > — paper [arXiv:2609.23888](https://arxiv.org/abs/2609.23888), submitted to **ICRA 2027**.
16
+ > Code: [github.com/Advanced-Robotic-Manipulation/HapticWAM](https://github.com/Advanced-Robotic-Manipulation/HapticWAM) · all repos: [HapticWAM — ICRA 2027](https://huggingface.co/collections/armteam/hapticwam-icra-2027-6ab234bdfe24c383b5f9fb57).
17
+
18
+ The tactile world-action-model **teacher**: the full-input model that sees the fingertip
19
+ tactile streams and is distilled into the deployed student.
20
+
21
+ **The checkpoint the paper deploys is `teacher_v6_simft/teacher_002000.pt`.**
22
+
23
+ ## Folders
24
+
25
+ | Folder | Files | Size | What it is |
26
+ |---|---|---|---|
27
+ | `teacher_v6_simft/` | 1 | 0.39 GB | **the deployed teacher.** `teacher_002000.pt`, v6 fine-tuned on simulation plus rig rollouts, 2,000 steps. |
28
+ | `teacher_v6/` | 10 | 0.79 GB | the v6 teacher before the sim fine-tune: `teacher_019000.pt`, `teacher_020000.pt`, the training log `train_v6.log`, and `eval/` with seven evaluation JSONs (steps 18k/19k/20k at NFE 1 and 5, plus a v5.6 comparison). `teacher_020000.pt` is the arm that runs on the rig as the teacher-only condition. |
29
+ | `eval/` | 4 | — | teacher evaluations at NFE 1 and 5 (`v6_teacher_nfe1`, `v6_teacher_nfe5`), each a JSON plus its log. |
30
+ | `text_embeddings.pt` | 1 | 0.82 GB | the Cosmos text-embedding cache for the task prompts. Not a checkpoint: it is a precomputed **input** that the provisioning scripts download next to the teacher and place at `data/phantom-episodes/tasks/`. It is regenerable from the prompts, and it is kept here so that provisioning reads one repo rather than two. |
31
+
32
+ `index.jsonl` lists every file here with its size, LFS sha256 and the path it was copied from.
33
+
34
+ ## Training data
35
+
36
+ Trained on [`armteam/hapticwam-teleop-dataset`](https://huggingface.co/datasets/armteam/hapticwam-teleop-dataset),
37
+ **1,115 teleoperation episodes** indexed by `manifests_v6.tar`. The sim fine-tune additionally
38
+ uses simulation episodes and the rig rollouts in
39
+ [`armteam/hapticwam-rollouts`](https://huggingface.co/datasets/armteam/hapticwam-rollouts).
40
+
41
+ ## Part of the HapticWAM release
42
+
43
+ Ten repos on the hub, gathered in the [HapticWAM — ICRA 2027 collection](https://huggingface.co/collections/armteam/hapticwam-icra-2027-6ab234bdfe24c383b5f9fb57).
44
+
45
+ | Repo | Kind | Holds |
46
+ |---|---|---|
47
+ | `armteam/hapticwam-teacher` **← you are here** | model | the tactile-input **teacher**. Deployed checkpoint `teacher_v6_simft/teacher_002000.pt`; also holds the Cosmos prompt cache `text_embeddings.pt` |
48
+ | [`armteam/hapticwam-student`](https://huggingface.co/armteam/hapticwam-student) | model | the distilled **pad-free student**, the model that runs on the rig. Deployed checkpoint `hid_simft/student_001000.pt` |
49
+ | [`armteam/hapticwam-baselines`](https://huggingface.co/armteam/hapticwam-baselines) | model | the pi0.5, Diffusion Policy and X-VLA baselines at the deployed steps |
50
+ | [`armteam/hapticwam-ablations`](https://huggingface.co/armteam/hapticwam-ablations) | model | every training arm that is not deployed, and the complete evaluation sweeps |
51
+ | [`armteam/hapticwam-teleop-dataset`](https://huggingface.co/datasets/armteam/hapticwam-teleop-dataset) | dataset | the training corpus — 1,115 teleoperated episodes, packed per task |
52
+ | [`armteam/hapticwam-teleop-raw`](https://huggingface.co/datasets/armteam/hapticwam-teleop-raw) | dataset | the same teleoperation as loose, as-recorded sessions (provenance) |
53
+ | [`armteam/hapticwam-sim-episodes`](https://huggingface.co/datasets/armteam/hapticwam-sim-episodes) | dataset | Isaac Sim expert episodes, used for the sim fine-tune |
54
+ | [`armteam/hapticwam-rig-episodes`](https://huggingface.co/datasets/armteam/hapticwam-rig-episodes) | dataset | the closed-loop rig takes the reported numbers are computed from |
55
+ | [`armteam/hapticwam-rollouts`](https://huggingface.co/datasets/armteam/hapticwam-rollouts) | dataset | policy-driven rollouts — the DAgger rounds and the deploy days |
56
+ | [`armteam/hapticwam-evidence`](https://huggingface.co/datasets/armteam/hapticwam-evidence) | dataset | per-take evidence behind the paper's tables — scored CSVs, probe JSONs, figures |
57
+
58
+ Code, training and deployment scripts: [github.com/Advanced-Robotic-Manipulation/HapticWAM](https://github.com/Advanced-Robotic-Manipulation/HapticWAM).
59
+
60
+ ## Licence
61
+
62
+ Model weights and the HapticWAM code: **Apache-2.0**. The datasets listed above: **CC-BY-4.0**.
eval/v6_teacher_nfe1.json ADDED
The diff for this file is too large to render. See raw diff
 
eval/v6_teacher_nfe1.log ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ /workspace/phantom-hid/phantom/tools/terminal_eval.py:372: UserWarning: hardware.yaml has real drivers enabled but meta.bench_verified=false — run docs/hardware_bench_day1.md and fill the BENCH fields first.
2
+ hw = load_hardware(args.hardware)
3
+ null semantics: {"mode": "none", "gt_contact_package": "zeroed", "contact_frames": "co_denoised_from_noise", "contact_frames_pinned_to": null, "batch_streams_zeroed": [], "prev_cpk": "as_sampled", "is_deploy_condition": true}
4
+ [09-08 22:56:09|INFO|cosmos-predict2.5/cosmos_predict2/_src/predict2/action/networks/action_conditioned_minimal_v1_lvg_dit.py:217:__init__] hidden_dim_in_action_embedder: 8192
5
+ [09-08 22:56:15|INFO|cosmos-predict2.5/cosmos_predict2/_src/predict2/tokenizers/wan2pt1.py:669:_video_vae] loading /workspace/phantom-hid/cosmos-predict2.5-2b/tokenizer.pth
6
+ hardware config VALUES differ from checkpoint provenance (shape-compatible — proceeding)
7
+ ep_Carton_1785609270_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
8
+ ep_Carton_1785609381_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
9
+ ep_Carton_1785609504_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
10
+ ep_Carton_1785609546_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
11
+ ep_Carton_1785609582_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
12
+ ep_Carton_1785609645_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
13
+ ep_Carton_1785609697_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
14
+ ep_Carton_1785609779_015 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
15
+ ep_Carton_1785609825_017 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
16
+ ep_Carton_1785609879_019 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
17
+ ep_Carton_1785610250_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
18
+ ep_Carton_1785610338_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
19
+ ep_Carton_1785610393_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
20
+ ep_Carton_1785610418_014 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
21
+ ep_Carton_1785610440_015 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
22
+ ep_Carton_1785610475_017 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
23
+ ep_Carton_1785610501_018 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
24
+ ep_Carton_1785610556_019 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
25
+ ep_Carton_1785610578_020 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
26
+ ep_Carton_1785610603_021 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
27
+ ep_egg_1785777018_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
28
+ ep_egg_1785777083_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
29
+ ep_egg_1785777201_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
30
+ ep_egg_1785777238_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
31
+ ep_egg_1785777267_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
32
+ ep_egg_1785777328_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
33
+ ep_egg_1785777359_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
34
+ ep_egg_1785777411_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
35
+ ep_egg_1785777450_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
36
+ ep_egg_1785777487_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
37
+ ep_egg_1785777628_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
38
+ ep_egg_1785777661_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
39
+ ep_egg_1785777733_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
40
+ ep_egg_1785777764_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
41
+ ep_egg_1785777794_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
42
+ ep_egg_1785777833_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
43
+ ep_egg_1785777862_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
44
+ ep_waffles_1785593827_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
45
+ ep_waffles_1785593867_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
46
+ ep_waffles_1785593910_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
47
+ ep_waffles_1785594008_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
48
+ ep_waffles_1785594044_014 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
49
+ ep_waffles_1785594102_016 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
50
+ ep_waffles_1785594125_017 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
51
+ ep_waffles_1785594169_018 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
52
+ ep_waffles_1785594205_020 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
53
+ ep_waffles_1785594230_021 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
54
+ ep_waffles_1785594294_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
55
+ ep_waffles_1785594329_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
56
+ ep_waffles_1785594380_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
57
+ ep_waffles_1785594403_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
58
+ ep_waffles_1785594465_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
59
+ ep_waffles_1785594503_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
60
+ ep_waffles_1785594563_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
61
+ ep_waffles_1785594701_020 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
62
+ ep_waffles_1785594728_021 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
63
+ ep_waffles_1785594797_024 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
64
+ ep_whiteboard_1785874897_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
65
+ ep_whiteboard_1785874979_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
66
+ ep_whiteboard_1785875018_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
67
+ ep_whiteboard_1785875056_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
68
+ ep_whiteboard_1785875094_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
69
+ ep_whiteboard_1785875140_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
70
+ ep_whiteboard_1785875178_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
71
+ ep_whiteboard_1785875259_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
72
+ ep_whiteboard_1785875299_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
73
+ ep_whiteboard_1785875338_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
74
+ ep_whiteboard_1785875453_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
75
+ ep_whiteboard_1785875489_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
76
+ ep_whiteboard_1785875525_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
77
+ ep_whiteboard_1785875566_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
78
+ ep_whiteboard_1785875603_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
79
+ ep_whiteboard_1785875641_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
80
+ ep_whiteboard_1785875682_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
81
+ ep_whiteboard_1785875719_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
82
+ ep_whiteboard_1785875757_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
83
+ ep_whiteboard_1785875799_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
84
+ ep_whiteboard_1785875870_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
85
+ ep_carton_1787400225_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
86
+ ep_carton_1787400259_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
87
+ ep_carton_1787400295_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
88
+ ep_carton_1787400366_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
89
+ ep_carton_1787400396_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
90
+ ep_carton_1787400429_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
91
+ ep_carton_1787400470_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
92
+ ep_carton_1787400502_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
93
+ ep_carton_1787400534_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
94
+ ep_carton_1787400568_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
95
+ ep_egg_1787405044_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
96
+ ep_egg_1787405083_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
97
+ ep_egg_1787405118_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
98
+ ep_egg_1787405151_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
99
+ ep_egg_1787405186_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
100
+ ep_egg_1787405223_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
101
+ ep_egg_1787405296_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
102
+ ep_egg_1787405332_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
103
+ ep_egg_1787405364_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
104
+ ep_egg_1787405397_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
105
+ ep_waffles_1787395928_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
106
+ ep_waffles_1787395963_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
107
+ ep_waffles_1787396028_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
108
+ ep_waffles_1787396060_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
109
+ ep_waffles_1787396094_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
110
+ ep_waffles_1787396128_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
111
+ ep_waffles_1787396273_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
112
+ ep_waffles_1787396314_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
113
+ ep_waffles_1787396346_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
114
+ ep_waffles_1787396461_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
115
+ ep_whiteboard_1787411199_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
116
+ ep_whiteboard_1787411234_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
117
+ ep_whiteboard_1787411268_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
118
+ ep_whiteboard_1787411306_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
119
+ ep_whiteboard_1787411344_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
120
+ ep_whiteboard_1787411481_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
121
+ ep_whiteboard_1787411521_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
122
+ ep_whiteboard_1787411589_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
123
+ ep_whiteboard_1787411627_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
124
+ ep_whiteboard_1787411670_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
125
+ ep_whiteboard_1787411764_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
126
+ ep_whiteboard_1787411803_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
127
+ ep_whiteboard_1787411849_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
128
+ ep_whiteboard_1787411888_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
129
+ ep_whiteboard_1787412075_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
130
+ ep_whiteboard_1787412112_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
131
+ episodes skipped (no close / chunk cannot span the close): 0
132
+ {
133
+ "nfe": 1,
134
+ "guidance": 1.0,
135
+ "seeds": 4,
136
+ "null": "none",
137
+ "null_semantics": {
138
+ "mode": "none",
139
+ "gt_contact_package": "zeroed",
140
+ "contact_frames": "co_denoised_from_noise",
141
+ "contact_frames_pinned_to": null,
142
+ "batch_streams_zeroed": [],
143
+ "prev_cpk": "as_sampled",
144
+ "is_deploy_condition": true
145
+ },
146
+ "student": false,
147
+ "split": "val",
148
+ "persistent_noise": false,
149
+ "max_episodes": null,
150
+ "ema": true,
151
+ "skipped": 0,
152
+ "n": 496,
153
+ "n_windows": 124,
154
+ "n_episodes": 124,
155
+ "endpoint_err_mm": 20.043371595888143,
156
+ "median_endpoint_err_mm": 14.09134120744864,
157
+ "seed_std_endpoint_err_mm": 4.7681973036461915,
158
+ "z_end_err_mm": 13.764878693769491,
159
+ "median_z_end_err_mm": 6.6192185046661205,
160
+ "seed_std_z_end_err_mm": 5.308566852413083,
161
+ "commit_ratio": 0.6528264599158723,
162
+ "median_commit_ratio": 0.5967414810787474,
163
+ "seed_std_commit_ratio": 0.32942908967940965,
164
+ "close_step_err": -1.6304347826086956,
165
+ "median_close_step_err": -2.0,
166
+ "seed_std_close_step_err": 1.499296175731736,
167
+ "pred_close_height_mm": 119.3134924045326,
168
+ "median_pred_close_height_mm": 116.66929174136149,
169
+ "seed_std_pred_close_height_mm": 2.414182766564993,
170
+ "per_task": {
171
+ "Carton": {
172
+ "endpoint_err_mm": 38.63766294885939,
173
+ "median_endpoint_err_mm": 22.702846210227555,
174
+ "seed_std_endpoint_err_mm": 11.268596278704596,
175
+ "z_end_err_mm": 31.07643446630687,
176
+ "median_z_end_err_mm": 16.69941787656594,
177
+ "seed_std_z_end_err_mm": 11.701354216552351,
178
+ "commit_ratio": 0.7779601842344609,
179
+ "median_commit_ratio": 0.36618448824852157,
180
+ "seed_std_commit_ratio": 0.8120261787117797,
181
+ "close_step_err": -0.8055555555555556,
182
+ "median_close_step_err": 0.0,
183
+ "seed_std_close_step_err": 1.6380330276705888,
184
+ "pred_close_height_mm": 122.92313110657456,
185
+ "median_pred_close_height_mm": 120.93614767505389,
186
+ "seed_std_pred_close_height_mm": 3.459845198187594,
187
+ "n": 120
188
+ },
189
+ "egg": {
190
+ "endpoint_err_mm": 5.210288167950645,
191
+ "median_endpoint_err_mm": 4.773714600128123,
192
+ "seed_std_endpoint_err_mm": 0.8240050371376663,
193
+ "z_end_err_mm": 1.532278639204692,
194
+ "median_z_end_err_mm": 1.310057707141739,
195
+ "seed_std_z_end_err_mm": 0.6683633551720076,
196
+ "commit_ratio": 0.41761995936793983,
197
+ "median_commit_ratio": 0.4097713055628053,
198
+ "seed_std_commit_ratio": 0.18867349917736004,
199
+ "close_step_err": -5.083333333333333,
200
+ "median_close_step_err": -6.0,
201
+ "seed_std_close_step_err": 1.702428397339372,
202
+ "pred_close_height_mm": 74.53863703615065,
203
+ "median_pred_close_height_mm": 74.92303555810858,
204
+ "seed_std_pred_close_height_mm": 0.6081280087585077,
205
+ "n": 108
206
+ },
207
+ "waffles": {
208
+ "endpoint_err_mm": 20.146335077702606,
209
+ "median_endpoint_err_mm": 18.12925471222095,
210
+ "seed_std_endpoint_err_mm": 2.698513063718927,
211
+ "z_end_err_mm": 9.648322669829213,
212
+ "median_z_end_err_mm": 6.303517606692372,
213
+ "seed_std_z_end_err_mm": 3.821847570985813,
214
+ "commit_ratio": 0.7314978950849177,
215
+ "median_commit_ratio": 0.7075138920482786,
216
+ "seed_std_commit_ratio": 0.15857730875329484,
217
+ "close_step_err": -1.4833333333333334,
218
+ "median_close_step_err": -2.0,
219
+ "seed_std_close_step_err": 1.417455152497023,
220
+ "pred_close_height_mm": 88.46155483218296,
221
+ "median_pred_close_height_mm": 87.39965995947475,
222
+ "seed_std_pred_close_height_mm": 2.9251532161667364,
223
+ "n": 120
224
+ },
225
+ "whiteboard": {
226
+ "endpoint_err_mm": 15.707577204286538,
227
+ "median_endpoint_err_mm": 15.519703167063632,
228
+ "seed_std_endpoint_err_mm": 4.053920253424458,
229
+ "z_end_err_mm": 11.992722180670473,
230
+ "median_z_end_err_mm": 11.877032545016377,
231
+ "seed_std_z_end_err_mm": 4.716768256309001,
232
+ "commit_ratio": 0.5981801925630105,
233
+ "median_commit_ratio": 0.6781805137318065,
234
+ "seed_std_commit_ratio": 0.15899861946275443,
235
+ "close_step_err": -0.3918918918918919,
236
+ "median_close_step_err": 0.0,
237
+ "seed_std_close_step_err": 1.3491220957569257,
238
+ "pred_close_height_mm": 168.9303956795315,
239
+ "median_pred_close_height_mm": 167.77888740695488,
240
+ "seed_std_pred_close_height_mm": 2.5586171885663194,
241
+ "n": 148
242
+ }
243
+ },
244
+ "gt_close_height_mm": 109.9366712341453,
245
+ "median_gt_close_height_mm": 98.10900550580403
246
+ }
eval/v6_teacher_nfe5.json ADDED
The diff for this file is too large to render. See raw diff
 
eval/v6_teacher_nfe5.log ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ /workspace/phantom-hid/phantom/tools/terminal_eval.py:372: UserWarning: hardware.yaml has real drivers enabled but meta.bench_verified=false — run docs/hardware_bench_day1.md and fill the BENCH fields first.
2
+ hw = load_hardware(args.hardware)
3
+ null semantics: {"mode": "none", "gt_contact_package": "zeroed", "contact_frames": "co_denoised_from_noise", "contact_frames_pinned_to": null, "batch_streams_zeroed": [], "prev_cpk": "as_sampled", "is_deploy_condition": true}
4
+ [09-08 23:07:54|INFO|cosmos-predict2.5/cosmos_predict2/_src/predict2/action/networks/action_conditioned_minimal_v1_lvg_dit.py:217:__init__] hidden_dim_in_action_embedder: 8192
5
+ [09-08 23:08:00|INFO|cosmos-predict2.5/cosmos_predict2/_src/predict2/tokenizers/wan2pt1.py:669:_video_vae] loading /workspace/phantom-hid/cosmos-predict2.5-2b/tokenizer.pth
6
+ hardware config VALUES differ from checkpoint provenance (shape-compatible — proceeding)
7
+ ep_Carton_1785609270_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
8
+ ep_Carton_1785609381_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
9
+ ep_Carton_1785609504_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
10
+ ep_Carton_1785609546_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
11
+ ep_Carton_1785609582_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
12
+ ep_Carton_1785609645_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
13
+ ep_Carton_1785609697_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
14
+ ep_Carton_1785609779_015 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
15
+ ep_Carton_1785609825_017 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
16
+ ep_Carton_1785609879_019 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
17
+ ep_Carton_1785610250_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
18
+ ep_Carton_1785610338_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
19
+ ep_Carton_1785610393_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
20
+ ep_Carton_1785610418_014 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
21
+ ep_Carton_1785610440_015 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
22
+ ep_Carton_1785610475_017 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
23
+ ep_Carton_1785610501_018 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
24
+ ep_Carton_1785610556_019 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
25
+ ep_Carton_1785610578_020 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
26
+ ep_Carton_1785610603_021 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
27
+ ep_egg_1785777018_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
28
+ ep_egg_1785777083_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
29
+ ep_egg_1785777201_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
30
+ ep_egg_1785777238_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
31
+ ep_egg_1785777267_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
32
+ ep_egg_1785777328_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
33
+ ep_egg_1785777359_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
34
+ ep_egg_1785777411_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
35
+ ep_egg_1785777450_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
36
+ ep_egg_1785777487_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
37
+ ep_egg_1785777628_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
38
+ ep_egg_1785777661_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
39
+ ep_egg_1785777733_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
40
+ ep_egg_1785777764_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
41
+ ep_egg_1785777794_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
42
+ ep_egg_1785777833_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
43
+ ep_egg_1785777862_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
44
+ ep_waffles_1785593827_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
45
+ ep_waffles_1785593867_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
46
+ ep_waffles_1785593910_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
47
+ ep_waffles_1785594008_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
48
+ ep_waffles_1785594044_014 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
49
+ ep_waffles_1785594102_016 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
50
+ ep_waffles_1785594125_017 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
51
+ ep_waffles_1785594169_018 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
52
+ ep_waffles_1785594205_020 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
53
+ ep_waffles_1785594230_021 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
54
+ ep_waffles_1785594294_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
55
+ ep_waffles_1785594329_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
56
+ ep_waffles_1785594380_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
57
+ ep_waffles_1785594403_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
58
+ ep_waffles_1785594465_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
59
+ ep_waffles_1785594503_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
60
+ ep_waffles_1785594563_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
61
+ ep_waffles_1785594701_020 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
62
+ ep_waffles_1785594728_021 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
63
+ ep_waffles_1785594797_024 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
64
+ ep_whiteboard_1785874897_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
65
+ ep_whiteboard_1785874979_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
66
+ ep_whiteboard_1785875018_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
67
+ ep_whiteboard_1785875056_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
68
+ ep_whiteboard_1785875094_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
69
+ ep_whiteboard_1785875140_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
70
+ ep_whiteboard_1785875178_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
71
+ ep_whiteboard_1785875259_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
72
+ ep_whiteboard_1785875299_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
73
+ ep_whiteboard_1785875338_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
74
+ ep_whiteboard_1785875453_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
75
+ ep_whiteboard_1785875489_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
76
+ ep_whiteboard_1785875525_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
77
+ ep_whiteboard_1785875566_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
78
+ ep_whiteboard_1785875603_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
79
+ ep_whiteboard_1785875641_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
80
+ ep_whiteboard_1785875682_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
81
+ ep_whiteboard_1785875719_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
82
+ ep_whiteboard_1785875757_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
83
+ ep_whiteboard_1785875799_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
84
+ ep_whiteboard_1785875870_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
85
+ ep_carton_1787400225_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
86
+ ep_carton_1787400259_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
87
+ ep_carton_1787400295_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
88
+ ep_carton_1787400366_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
89
+ ep_carton_1787400396_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
90
+ ep_carton_1787400429_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
91
+ ep_carton_1787400470_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
92
+ ep_carton_1787400502_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
93
+ ep_carton_1787400534_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
94
+ ep_carton_1787400568_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
95
+ ep_egg_1787405044_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
96
+ ep_egg_1787405083_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
97
+ ep_egg_1787405118_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
98
+ ep_egg_1787405151_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
99
+ ep_egg_1787405186_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
100
+ ep_egg_1787405223_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
101
+ ep_egg_1787405296_007 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
102
+ ep_egg_1787405332_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
103
+ ep_egg_1787405364_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
104
+ ep_egg_1787405397_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
105
+ ep_waffles_1787395928_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
106
+ ep_waffles_1787395963_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
107
+ ep_waffles_1787396028_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
108
+ ep_waffles_1787396060_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
109
+ ep_waffles_1787396094_005 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
110
+ ep_waffles_1787396128_006 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
111
+ ep_waffles_1787396273_010 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
112
+ ep_waffles_1787396314_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
113
+ ep_waffles_1787396346_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
114
+ ep_waffles_1787396461_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
115
+ ep_whiteboard_1787411199_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
116
+ ep_whiteboard_1787411234_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
117
+ ep_whiteboard_1787411268_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
118
+ ep_whiteboard_1787411306_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
119
+ ep_whiteboard_1787411344_004 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
120
+ ep_whiteboard_1787411481_008 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
121
+ ep_whiteboard_1787411521_009 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
122
+ ep_whiteboard_1787411589_011 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
123
+ ep_whiteboard_1787411627_012 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
124
+ ep_whiteboard_1787411670_013 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
125
+ ep_whiteboard_1787411764_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
126
+ ep_whiteboard_1787411803_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
127
+ ep_whiteboard_1787411849_002 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
128
+ ep_whiteboard_1787411888_003 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
129
+ ep_whiteboard_1787412075_000 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
130
+ ep_whiteboard_1787412112_001 recorded under a different hardware config hash (values drifted — shapes are asserted separately)
131
+ episodes skipped (no close / chunk cannot span the close): 0
132
+ {
133
+ "nfe": 5,
134
+ "guidance": 1.0,
135
+ "seeds": 4,
136
+ "null": "none",
137
+ "null_semantics": {
138
+ "mode": "none",
139
+ "gt_contact_package": "zeroed",
140
+ "contact_frames": "co_denoised_from_noise",
141
+ "contact_frames_pinned_to": null,
142
+ "batch_streams_zeroed": [],
143
+ "prev_cpk": "as_sampled",
144
+ "is_deploy_condition": true
145
+ },
146
+ "student": false,
147
+ "split": "val",
148
+ "persistent_noise": false,
149
+ "max_episodes": null,
150
+ "ema": true,
151
+ "skipped": 0,
152
+ "n": 496,
153
+ "n_windows": 124,
154
+ "n_episodes": 124,
155
+ "endpoint_err_mm": 19.264766236206693,
156
+ "median_endpoint_err_mm": 12.681246909706068,
157
+ "seed_std_endpoint_err_mm": 8.842835554989598,
158
+ "z_end_err_mm": 11.478517838561357,
159
+ "median_z_end_err_mm": 4.84953654109178,
160
+ "seed_std_z_end_err_mm": 9.479228976738918,
161
+ "commit_ratio": 0.6918723144294807,
162
+ "median_commit_ratio": 0.6850315478150932,
163
+ "seed_std_commit_ratio": 0.4787389771050404,
164
+ "close_step_err": -0.8782608695652174,
165
+ "median_close_step_err": 0.0,
166
+ "seed_std_close_step_err": 2.147911415888413,
167
+ "pred_close_height_mm": 116.03455670259123,
168
+ "median_pred_close_height_mm": 110.09180327788134,
169
+ "seed_std_pred_close_height_mm": 3.366551795298585,
170
+ "per_task": {
171
+ "Carton": {
172
+ "endpoint_err_mm": 31.49296241231765,
173
+ "median_endpoint_err_mm": 19.014721555390437,
174
+ "seed_std_endpoint_err_mm": 16.541702033018076,
175
+ "z_end_err_mm": 21.68926801445866,
176
+ "median_z_end_err_mm": 8.783212253438649,
177
+ "seed_std_z_end_err_mm": 16.880140159947473,
178
+ "commit_ratio": 0.9545034060854823,
179
+ "median_commit_ratio": 0.56361353340488,
180
+ "seed_std_commit_ratio": 0.9208040930062984,
181
+ "close_step_err": -0.26851851851851855,
182
+ "median_close_step_err": 1.0,
183
+ "seed_std_close_step_err": 1.7894752876105398,
184
+ "pred_close_height_mm": 119.93814688514703,
185
+ "median_pred_close_height_mm": 118.6259910221825,
186
+ "seed_std_pred_close_height_mm": 4.726885151846491,
187
+ "n": 120
188
+ },
189
+ "egg": {
190
+ "endpoint_err_mm": 6.033273948479877,
191
+ "median_endpoint_err_mm": 5.194976584994837,
192
+ "seed_std_endpoint_err_mm": 1.6427426204692324,
193
+ "z_end_err_mm": 2.484284178313976,
194
+ "median_z_end_err_mm": 2.494693705859894,
195
+ "seed_std_z_end_err_mm": 1.3157157742424697,
196
+ "commit_ratio": 0.10823559748625829,
197
+ "median_commit_ratio": 0.04113379610358869,
198
+ "seed_std_commit_ratio": 0.3865685242387685,
199
+ "close_step_err": -3.630952380952381,
200
+ "median_close_step_err": -4.0,
201
+ "seed_std_close_step_err": 2.803052792925891,
202
+ "pred_close_height_mm": 73.96591845360534,
203
+ "median_pred_close_height_mm": 74.18384928096462,
204
+ "seed_std_pred_close_height_mm": 0.7822019059365511,
205
+ "n": 108
206
+ },
207
+ "waffles": {
208
+ "endpoint_err_mm": 25.15237365172812,
209
+ "median_endpoint_err_mm": 19.314805466131627,
210
+ "seed_std_endpoint_err_mm": 11.40232135603445,
211
+ "z_end_err_mm": 13.268374198130495,
212
+ "median_z_end_err_mm": 8.05719581951995,
213
+ "seed_std_z_end_err_mm": 12.125003086011782,
214
+ "commit_ratio": 0.6522364488326271,
215
+ "median_commit_ratio": 0.7207213543501202,
216
+ "seed_std_commit_ratio": 0.4231382722692256,
217
+ "close_step_err": -1.0166666666666666,
218
+ "median_close_step_err": -1.0,
219
+ "seed_std_close_step_err": 2.354368797846236,
220
+ "pred_close_height_mm": 87.31149369215052,
221
+ "median_pred_close_height_mm": 85.18389305274027,
222
+ "seed_std_pred_close_height_mm": 4.966742819841915,
223
+ "n": 120
224
+ },
225
+ "whiteboard": {
226
+ "endpoint_err_mm": 14.23169012862973,
227
+ "median_endpoint_err_mm": 12.524033915621459,
228
+ "seed_std_endpoint_err_mm": 5.779374497147702,
229
+ "z_end_err_mm": 8.311656021336661,
230
+ "median_z_end_err_mm": 6.953677347709547,
231
+ "seed_std_z_end_err_mm": 7.2904262116838305,
232
+ "commit_ratio": 0.7765738551600823,
233
+ "median_commit_ratio": 0.7940346720096432,
234
+ "seed_std_commit_ratio": 0.2276396376689256,
235
+ "close_step_err": 0.35135135135135137,
236
+ "median_close_step_err": 1.0,
237
+ "seed_std_close_step_err": 1.8702380398608691,
238
+ "pred_close_height_mm": 166.545941823256,
239
+ "median_pred_close_height_mm": 165.72341948106745,
240
+ "seed_std_pred_close_height_mm": 3.2397229851528038,
241
+ "n": 148
242
+ }
243
+ },
244
+ "gt_close_height_mm": 109.9366712341453,
245
+ "median_gt_close_height_mm": 98.10900550580403
246
+ }
index.jsonl ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"path": ".gitattributes", "size": 1519, "sha256": null, "blob_id": "a6344aac8c09253b3b630fb776ae94478aa0275b", "source": null}
2
+ {"path": "README.md", "size": 2405, "sha256": null, "blob_id": "5a757a9dff608249d583c6a795a5e020ba4eb502", "source": null}
3
+ {"path": "eval/v6_teacher_nfe1.json", "size": 234371, "sha256": null, "blob_id": "b07f59c48d111cba4371c75599cee21c03748ff5", "source": "armteam/phantom-checkpoints/eval_v6/v6_teacher_nfe1.json"}
4
+ {"path": "eval/v6_teacher_nfe1.log", "size": 20681, "sha256": null, "blob_id": "59f8c68aab44e46f96c2f57e8b08eeb767a96d01", "source": "armteam/phantom-checkpoints/eval_v6/v6_teacher_nfe1.log"}
5
+ {"path": "eval/v6_teacher_nfe5.json", "size": 234058, "sha256": null, "blob_id": "b3487f130ea2181a7cdc1de3a0cde61bda3a1128", "source": "armteam/phantom-checkpoints/eval_v6/v6_teacher_nfe5.json"}
6
+ {"path": "eval/v6_teacher_nfe5.log", "size": 20670, "sha256": null, "blob_id": "15b9c2240f0c12e9ce67607695974825b9156a63", "source": "armteam/phantom-checkpoints/eval_v6/v6_teacher_nfe5.log"}
7
+ {"path": "index.jsonl", "size": 3585, "sha256": null, "blob_id": "25a3e58d8b62a5241046d98593b31c53b13e87b6", "source": null}
8
+ {"path": "teacher_v6/eval/v5_6_nfe1.json", "size": 233697, "sha256": null, "blob_id": "f9d84161d2c0eabc1b05a7f01a27630c837bbafa", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v5_6_nfe1.json"}
9
+ {"path": "teacher_v6/eval/v6_teacher_018000_nfe1.json", "size": 234442, "sha256": null, "blob_id": "5a582e947363e71234dc637da3f81d3e755cb6d5", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v6_teacher_018000_nfe1.json"}
10
+ {"path": "teacher_v6/eval/v6_teacher_018000_nfe5.json", "size": 234118, "sha256": null, "blob_id": "c3b50796c961e358785ff685e0ae0855f860090a", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v6_teacher_018000_nfe5.json"}
11
+ {"path": "teacher_v6/eval/v6_teacher_019000_nfe1.json", "size": 234361, "sha256": null, "blob_id": "66140bebae5d48a425826ecda20f0f51ab457c77", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v6_teacher_019000_nfe1.json"}
12
+ {"path": "teacher_v6/eval/v6_teacher_019000_nfe5.json", "size": 234007, "sha256": null, "blob_id": "2b55c57c9132eb0a7efde2a68c8eeebbb6f40564", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v6_teacher_019000_nfe5.json"}
13
+ {"path": "teacher_v6/eval/v6_teacher_020000_nfe1.json", "size": 234342, "sha256": null, "blob_id": "dbbe9433fe007322cb7484faa7a369068adb4b54", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v6_teacher_020000_nfe1.json"}
14
+ {"path": "teacher_v6/eval/v6_teacher_020000_nfe5.json", "size": 234016, "sha256": null, "blob_id": "4bc1b5655e5b3324ce4912015f49565ad5b9837e", "source": "armteam/phantom-checkpoints/teacher_v6/eval/v6_teacher_020000_nfe5.json"}
15
+ {"path": "teacher_v6/teacher_019000.pt", "size": 393116245, "sha256": "c9a0927443cb838226154559b3eb223ac40933bcee8ccdae27609ccb502aa6bc", "blob_id": "40cc7173a7ef6a38c869a27807633b7ced86f4d0", "source": "armteam/phantom-checkpoints/teacher_v6/teacher_019000.pt"}
16
+ {"path": "teacher_v6/teacher_020000.pt", "size": 393116245, "sha256": "4812cfbf012781f0e2e2f96d3b4e4b5b228806912418ce0127269bcdb5390fa2", "blob_id": "40ef29dcad6ce8151a447e392c798c379206ea95", "source": "armteam/phantom-checkpoints/teacher_v6/teacher_020000.pt"}
17
+ {"path": "teacher_v6/train_v6.log", "size": 5264468, "sha256": null, "blob_id": "01f554a52a8dc701be86371a43ac7906c3cf8b35", "source": "armteam/phantom-checkpoints/teacher_v6/train_v6.log"}
18
+ {"path": "teacher_v6_simft/teacher_002000.pt", "size": 393116309, "sha256": "1df9fc93510cf5660c99e433abed435a4d5a2aff3a7a670b6a32c96bf0ad4e14", "blob_id": "2775cd6f8f6694ed975c010304f19b2980f68002", "source": "armteam/phantom-checkpoints/teacher_v6_simft/teacher_002000.pt"}
19
+ {"path": "text_embeddings.pt", "size": 822087421, "sha256": "bef6ad98d2925799c2768084cb5886c8770627f861924088a8a721316883453b", "blob_id": "d5c52051ee8e43aed6bcd4b6868682c024eca82d", "source": "armteam/phantom-checkpoints/dataset_v3_packed/text_embeddings.pt"}
teacher_v6/eval/v5_6_nfe1.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/eval/v6_teacher_018000_nfe1.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/eval/v6_teacher_018000_nfe5.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/eval/v6_teacher_019000_nfe1.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/eval/v6_teacher_019000_nfe5.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/eval/v6_teacher_020000_nfe1.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/eval/v6_teacher_020000_nfe5.json ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6/teacher_019000.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9a0927443cb838226154559b3eb223ac40933bcee8ccdae27609ccb502aa6bc
3
+ size 393116245
teacher_v6/teacher_020000.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4812cfbf012781f0e2e2f96d3b4e4b5b228806912418ce0127269bcdb5390fa2
3
+ size 393116245
teacher_v6/train_v6.log ADDED
The diff for this file is too large to render. See raw diff
 
teacher_v6_simft/teacher_002000.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1df9fc93510cf5660c99e433abed435a4d5a2aff3a7a670b6a32c96bf0ad4e14
3
+ size 393116309
text_embeddings.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bef6ad98d2925799c2768084cb5886c8770627f861924088a8a721316883453b
3
+ size 822087421