model card
Browse files
README.md
CHANGED
|
@@ -1,23 +1,37 @@
|
|
| 1 |
---
|
| 2 |
license: agpl-3.0
|
| 3 |
tags:
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
#
|
| 11 |
|
| 12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
-
##
|
| 15 |
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
| `se-shadow_5000_40` | Shadow Hand | 22 | 40 / 500 | 75.9% | 0.232 |
|
| 20 |
|
| 21 |
-
|
| 22 |
|
| 23 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: agpl-3.0
|
| 3 |
tags:
|
| 4 |
+
- robotics
|
| 5 |
+
- grasping
|
| 6 |
+
- flow-matching
|
| 7 |
+
- jax
|
| 8 |
+
- flax
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# kinematics-flow — multi-embodiment grasp generation (early checkpoint)
|
| 12 |
|
| 13 |
+
Checkpoint of the full multi-embodiment model from
|
| 14 |
+
[Towards a Multi-Embodied Grasping Agent](https://arxiv.org/abs/2510.27420)
|
| 15 |
+
(code: [boschresearch/kinematics-flow](https://github.com/boschresearch/kinematics-flow)),
|
| 16 |
+
trained on AMD MI300X (ROCm) with the paper's full configuration:
|
| 17 |
+
all five grippers (Panda, VX300, DexEE, Allegro, ShadowHand) + z0, 25,000 scenes,
|
| 18 |
+
fp32, batch 5 scenes × 128 grasps, warmup-cosine LR (peak 3e-4).
|
| 19 |
|
| 20 |
+
## Contents
|
| 21 |
|
| 22 |
+
- `me-full_25000_5/` — Orbax (OCDBT) checkpoint at **epoch 5** (~25,000 train steps).
|
| 23 |
+
**Early checkpoint** — the paper trains ~120 epochs for full quality; this is a
|
| 24 |
+
work-in-progress snapshot, expect rough grasps.
|
|
|
|
| 25 |
|
| 26 |
+
## Loading
|
| 27 |
|
| 28 |
+
```python
|
| 29 |
+
from kin_flow.ctrl.trainer import Trainer
|
| 30 |
+
from kin_flow.net.kinematics_flow import KinematicsFlow, KinematicsFlowConfiguration
|
| 31 |
+
# build `model` from the repo's train.yaml config, then:
|
| 32 |
+
model = Trainer.get_model_from_checkpoint(model, "<path>/me-full_25000_5")
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
Note: trained with flax 0.11 and a per-path `nnx.Param` layout in
|
| 36 |
+
`TPWithWeightsAndBiases` (`kin_flow/net/module/fctp.py`) — restore with a matching
|
| 37 |
+
code state; checkpoints are not compatible with the original Param-of-list layout.
|