Dimios45 commited on
Commit
52a6096
·
verified ·
1 Parent(s): d28849a

README: final epoch-120 eval results (mean SR 86.1%, NJD 0.209)

Browse files
Files changed (1) hide show
  1. README.md +15 -3
README.md CHANGED
@@ -26,7 +26,7 @@ diversity (NJD), computed via `kin_flow.cli.bench` on 10 held-out test scenes wi
26
  | `me-full_25000_5` | multi-embodiment | all 5 + z0 | 5 / 500 | 82.1% (mean) | 0.212 (mean) | MI300X (ROCm) |
27
  | `me-full_25000_30` | multi-embodiment | all 5 + z0 | 30 / 500 | 84.3% (mean) | 0.203 (mean) | MI300X (ROCm) |
28
  | `me-full_25000_90` | multi-embodiment | all 5 + z0 | 90 / 500 | 86.4% (mean) | 0.212 (mean) | MI300X (ROCm) |
29
- | `me-full_25000_120` | multi-embodiment | all 5 + z0 | **120** (target) | eval pending | eval pending | MI300X (ROCm) |
30
 
31
  Single-embodiment models: `num_scenes=5000`. Multi-embodiment model: the paper's full
32
  configuration — `num_scenes=25000`, fp32, batch 5 scenes × 128 grasps, warmup-cosine LR
@@ -72,8 +72,20 @@ step; epoch numbers here are the corrected true dataset-pass count.
72
  Training finished 2026-07-15 at exactly **120.0 true dataset passes** (gradient step
73
  302,000 = 3,000,000 scene-visits / 25,000 scenes), the convergence point recommended by
74
  the original repo's README. Saved from the step-302,000 train-state checkpoint, so it
75
- also contains optimizer state for further fine-tuning. Per-gripper eval is pending and
76
- will be added here once complete.
 
 
 
 
 
 
 
 
 
 
 
 
77
 
78
  ## Loading
79
 
 
26
  | `me-full_25000_5` | multi-embodiment | all 5 + z0 | 5 / 500 | 82.1% (mean) | 0.212 (mean) | MI300X (ROCm) |
27
  | `me-full_25000_30` | multi-embodiment | all 5 + z0 | 30 / 500 | 84.3% (mean) | 0.203 (mean) | MI300X (ROCm) |
28
  | `me-full_25000_90` | multi-embodiment | all 5 + z0 | 90 / 500 | 86.4% (mean) | 0.212 (mean) | MI300X (ROCm) |
29
+ | `me-full_25000_120` | multi-embodiment | all 5 + z0 | **120** (target) | 86.1% (mean) | 0.209 (mean) | MI300X (ROCm) |
30
 
31
  Single-embodiment models: `num_scenes=5000`. Multi-embodiment model: the paper's full
32
  configuration — `num_scenes=25000`, fp32, batch 5 scenes × 128 grasps, warmup-cosine LR
 
72
  Training finished 2026-07-15 at exactly **120.0 true dataset passes** (gradient step
73
  302,000 = 3,000,000 scene-visits / 25,000 scenes), the convergence point recommended by
74
  the original repo's README. Saved from the step-302,000 train-state checkpoint, so it
75
+ also contains optimizer state for further fine-tuning.
76
+
77
+ | Gripper | DOF | SR | NJD |
78
+ |---|---|---|---|
79
+ | Panda | 2 | 97.5% | 0.257 |
80
+ | VX300 | 2 | 97.4% | 0.134 |
81
+ | DexEE | 12 | 73.0% | 0.114 |
82
+ | Allegro | 16 | 85.4% | 0.288 |
83
+ | Shadow Hand | 22 | 77.3% | 0.250 |
84
+ | **mean** | | **86.1%** | **0.209** |
85
+
86
+ Mean SR is flat vs. epoch 90 (86.1% vs 86.4%, within eval noise at 10 scenes × 100
87
+ grasps), i.e. the model has converged — consistent with the original repo's guidance
88
+ that ~120 epochs give reasonable convergence.
89
 
90
  ## Loading
91