Update README with action space documentation and delta_legacy usage instructions
Browse files
README.md
CHANGED
|
@@ -1,3 +1,70 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# MIP Checkpoints
|
| 6 |
+
|
| 7 |
+
Pre-trained checkpoints for the [MIP (Minimum Iterative Policy)](https://github.com/simchowitzlabpublic/much-ado-fresh) framework.
|
| 8 |
+
|
| 9 |
+
## Repository Structure
|
| 10 |
+
|
| 11 |
+
```
|
| 12 |
+
robomimic/
|
| 13 |
+
{task}_{env_type}_{obs_type}/
|
| 14 |
+
delta_legacy/ # Original checkpoints (rot6d repr + delta controller)
|
| 15 |
+
abs/ # Absolute action space checkpoints
|
| 16 |
+
delta/ # Delta action space checkpoints (7D, no rot6d)
|
| 17 |
+
rel/ # Relative action space checkpoints
|
| 18 |
+
pusht/ # PushT environment checkpoints
|
| 19 |
+
kitchen/ # Kitchen environment checkpoints
|
| 20 |
+
```
|
| 21 |
+
|
| 22 |
+
## Robomimic Action Spaces
|
| 23 |
+
|
| 24 |
+
| Action Space | Config Suffix | `abs_action` | `action_type` | Dataset | `act_dim` (single/dual) |
|
| 25 |
+
|---|---|---|---|---|---|
|
| 26 |
+
| **delta_legacy** | `_delta_legacy` | `true` | `delta` | `low_dim.hdf5` | 10 / 20 |
|
| 27 |
+
| **absolute** | `_abs` | `true` | `absolute` | `low_dim_abs.hdf5` | 10 / 20 |
|
| 28 |
+
| **delta** | `_delta` | `false` | `delta` | `low_dim.hdf5` | 7 / 14 |
|
| 29 |
+
| **relative** | `_rel` | `true` | `relative` | `low_dim_abs.hdf5` | 10 / 20 |
|
| 30 |
+
|
| 31 |
+
> **Important:** The majority of released robomimic checkpoints (under `delta_legacy/`) were trained
|
| 32 |
+
> with the **delta_legacy** action space. You **must** use the corresponding `_delta_legacy` task
|
| 33 |
+
> config to evaluate them correctly. Using the default config (which uses absolute actions) will
|
| 34 |
+
> result in 0% success rate due to normalizer and controller mismatches.
|
| 35 |
+
|
| 36 |
+
## Quick Start: Evaluating a Checkpoint
|
| 37 |
+
|
| 38 |
+
```bash
|
| 39 |
+
# Download and evaluate a delta_legacy checkpoint
|
| 40 |
+
uv run examples/train_robomimic.py \
|
| 41 |
+
mode=eval \
|
| 42 |
+
task=lift_ph_state_delta_legacy \
|
| 43 |
+
network=chiunet \
|
| 44 |
+
optimization.loss_type=mip \
|
| 45 |
+
optimization.model_path="path/to/lift_ph_state_mip_chiunet_256_seed3_success100.pt"
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
### Available Task Configs
|
| 49 |
+
|
| 50 |
+
Each robomimic task has configs for all four action spaces:
|
| 51 |
+
|
| 52 |
+
- `lift_ph_state_delta_legacy`, `lift_ph_state_abs`, `lift_ph_state_delta`, `lift_ph_state_rel`
|
| 53 |
+
- `can_ph_state_delta_legacy`, `can_ph_state_abs`, `can_ph_state_delta`, `can_ph_state_rel`
|
| 54 |
+
- `square_ph_state_delta_legacy`, `square_ph_state_abs`, `square_ph_state_delta`, `square_ph_state_rel`
|
| 55 |
+
- `tool_hang_ph_state_delta_legacy`, `tool_hang_ph_state_abs`, `tool_hang_ph_state_delta`, `tool_hang_ph_state_rel`
|
| 56 |
+
- `transport_ph_state_delta_legacy`, `transport_ph_state_abs`, `transport_ph_state_delta`, `transport_ph_state_rel`
|
| 57 |
+
|
| 58 |
+
The `_mh` (multi-human) variants are also available (e.g., `lift_mh_state_delta_legacy`).
|
| 59 |
+
|
| 60 |
+
## Checkpoint Naming Convention
|
| 61 |
+
|
| 62 |
+
```
|
| 63 |
+
{loss_type}_{network}_{dim}_seed{N}_success{N}.pt
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
- **loss_type**: `mip`, `flow`, `regression`, `psd`, `lsd`, `straight_flow`
|
| 67 |
+
- **network**: `chiunet`, `chitransformer`, `mlp`, `sudeepdit`, `rnn`
|
| 68 |
+
- **dim**: embedding dimension (e.g., `256`, `384`, `512`)
|
| 69 |
+
- **seed**: random seed
|
| 70 |
+
- **success**: best evaluation success rate (%)
|