Dimios45 commited on
Commit
c522d61
·
verified ·
1 Parent(s): 3ab3575

model card

Browse files
Files changed (1) hide show
  1. README.md +27 -13
README.md CHANGED
@@ -1,23 +1,37 @@
1
  ---
2
  license: agpl-3.0
3
  tags:
4
- - grasping
5
- - jax
6
- - equivariance
7
- - multi-embodiment
 
8
  ---
9
 
10
- # Kinematics Flow checkpoints
11
 
12
- Single-embodiment checkpoints for [Kinematics Flow](https://github.com/boschresearch/kinematics-flow), from ["Towards a Multi-Embodied Grasping Agent"](https://arxiv.org/abs/2510.27420). These are **mid-training checkpoints**, not final converged models.
 
 
 
 
 
13
 
14
- ## Checkpoints
15
 
16
- | Folder | Gripper | DOF | Epoch | Test success rate | Test NJD |
17
- |---|---|---|---|---|---|
18
- | `se-panda_5000_170` | Panda | 2 | 170 / 500 | 97.8% | 0.293 |
19
- | `se-shadow_5000_40` | Shadow Hand | 22 | 40 / 500 | 75.9% | 0.232 |
20
 
21
- Both trained with `num_scenes=5000` on a single RTX 6000 Ada (48GB). Eval numbers are simulation-based grasp success rate and normalized joint diversity (NJD), computed via `kin_flow.cli.bench` on 10 held-out test scenes (100 sampled grasps/scene each).
22
 
23
- Format: orbax/OCDBT checkpoint directories, loadable via `kin_flow.ctrl.trainer.Trainer.get_model_from_checkpoint`.
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: agpl-3.0
3
  tags:
4
+ - robotics
5
+ - grasping
6
+ - flow-matching
7
+ - jax
8
+ - flax
9
  ---
10
 
11
+ # kinematics-flow multi-embodiment grasp generation (early checkpoint)
12
 
13
+ Checkpoint of the full multi-embodiment model from
14
+ [Towards a Multi-Embodied Grasping Agent](https://arxiv.org/abs/2510.27420)
15
+ (code: [boschresearch/kinematics-flow](https://github.com/boschresearch/kinematics-flow)),
16
+ trained on AMD MI300X (ROCm) with the paper's full configuration:
17
+ all five grippers (Panda, VX300, DexEE, Allegro, ShadowHand) + z0, 25,000 scenes,
18
+ fp32, batch 5 scenes × 128 grasps, warmup-cosine LR (peak 3e-4).
19
 
20
+ ## Contents
21
 
22
+ - `me-full_25000_5/` Orbax (OCDBT) checkpoint at **epoch 5** (~25,000 train steps).
23
+ **Early checkpoint** — the paper trains ~120 epochs for full quality; this is a
24
+ work-in-progress snapshot, expect rough grasps.
 
25
 
26
+ ## Loading
27
 
28
+ ```python
29
+ from kin_flow.ctrl.trainer import Trainer
30
+ from kin_flow.net.kinematics_flow import KinematicsFlow, KinematicsFlowConfiguration
31
+ # build `model` from the repo's train.yaml config, then:
32
+ model = Trainer.get_model_from_checkpoint(model, "<path>/me-full_25000_5")
33
+ ```
34
+
35
+ Note: trained with flax 0.11 and a per-path `nnx.Param` layout in
36
+ `TPWithWeightsAndBiases` (`kin_flow/net/module/fctp.py`) — restore with a matching
37
+ code state; checkpoints are not compatible with the original Param-of-list layout.