add me-full epoch-30 checkpoint eval to model card
Browse files
README.md
CHANGED
|
@@ -24,6 +24,7 @@ diversity (NJD), computed via `kin_flow.cli.bench` on 10 held-out test scenes wi
|
|
| 24 |
| `se-panda_5000_170` | single-embodiment | Panda (2 DOF) | 170 / 500 | 97.8% | 0.293 | RTX 6000 Ada |
|
| 25 |
| `se-shadow_5000_40` | single-embodiment | Shadow Hand (22 DOF) | 40 / 500 | 75.9% | 0.232 | RTX 6000 Ada |
|
| 26 |
| `me-full_25000_5` | multi-embodiment | all 5 + z0 | 5 / 500 | 82.1% (mean) | 0.212 (mean) | MI300X (ROCm) |
|
|
|
|
| 27 |
|
| 28 |
Single-embodiment models: `num_scenes=5000`. Multi-embodiment model: the paper's full
|
| 29 |
configuration — `num_scenes=25000`, fp32, batch 5 scenes × 128 grasps, warmup-cosine LR
|
|
@@ -40,7 +41,18 @@ configuration — `num_scenes=25000`, fp32, batch 5 scenes × 128 grasps, warmup
|
|
| 40 |
| Shadow Hand | 22 | 75.3% | 0.232 |
|
| 41 |
| **mean** | | **82.1%** | **0.212** |
|
| 42 |
|
| 43 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
will be added as training progresses.
|
| 45 |
|
| 46 |
## Loading
|
|
@@ -54,6 +66,7 @@ from kin_flow.net.kinematics_flow import KinematicsFlow, KinematicsFlowConfigura
|
|
| 54 |
model = Trainer.get_model_from_checkpoint(model, "<path>/me-full_25000_5")
|
| 55 |
```
|
| 56 |
|
| 57 |
-
Note: `me-
|
| 58 |
-
in `TPWithWeightsAndBiases` (`kin_flow/net/module/fctp.py`) —
|
| 59 |
-
code state;
|
|
|
|
|
|
| 24 |
| `se-panda_5000_170` | single-embodiment | Panda (2 DOF) | 170 / 500 | 97.8% | 0.293 | RTX 6000 Ada |
|
| 25 |
| `se-shadow_5000_40` | single-embodiment | Shadow Hand (22 DOF) | 40 / 500 | 75.9% | 0.232 | RTX 6000 Ada |
|
| 26 |
| `me-full_25000_5` | multi-embodiment | all 5 + z0 | 5 / 500 | 82.1% (mean) | 0.212 (mean) | MI300X (ROCm) |
|
| 27 |
+
| `me-full_25000_30` | multi-embodiment | all 5 + z0 | 30 / 500 | 84.3% (mean) | 0.203 (mean) | MI300X (ROCm) |
|
| 28 |
|
| 29 |
Single-embodiment models: `num_scenes=5000`. Multi-embodiment model: the paper's full
|
| 30 |
configuration — `num_scenes=25000`, fp32, batch 5 scenes × 128 grasps, warmup-cosine LR
|
|
|
|
| 41 |
| Shadow Hand | 22 | 75.3% | 0.232 |
|
| 42 |
| **mean** | | **82.1%** | **0.212** |
|
| 43 |
|
| 44 |
+
### `me-full_25000_30` per-gripper eval (epoch 30)
|
| 45 |
+
|
| 46 |
+
| Gripper | DOF | SR | NJD |
|
| 47 |
+
|---|---|---|---|
|
| 48 |
+
| Panda | 2 | 96.0% | 0.252 |
|
| 49 |
+
| VX300 | 2 | 93.3% | 0.159 |
|
| 50 |
+
| DexEE | 12 | 76.0% | 0.095 |
|
| 51 |
+
| Allegro | 16 | 84.4% | 0.283 |
|
| 52 |
+
| Shadow Hand | 22 | 71.6% | 0.224 |
|
| 53 |
+
| **mean** | | **84.3%** | **0.203** |
|
| 54 |
+
|
| 55 |
+
Still an early snapshot (epoch 30 of ~120 needed for convergence) — newer-epoch checkpoints
|
| 56 |
will be added as training progresses.
|
| 57 |
|
| 58 |
## Loading
|
|
|
|
| 66 |
model = Trainer.get_model_from_checkpoint(model, "<path>/me-full_25000_5")
|
| 67 |
```
|
| 68 |
|
| 69 |
+
Note: `me-full_25000_*` checkpoints were trained with flax 0.11 using a per-path
|
| 70 |
+
`nnx.Param` layout in `TPWithWeightsAndBiases` (`kin_flow/net/module/fctp.py`) —
|
| 71 |
+
restore with a matching code state; they are not compatible with the original
|
| 72 |
+
Param-of-list layout.
|