README.md

---
license: other
library_name: openpi
pipeline_tag: robotics
tags:
- robotics
- vla
- manipulation
- bimanual
- lerobot
- openpi
datasets:
- axiboai/piper_stacking
---

# π₀ · piper_stacking (bimanual cube stacking)

π₀ policy fine-tuned with [openpi](https://github.com/Physical-Intelligence/openpi) on
**[axiboai/piper_stacking](https://huggingface.co/datasets/axiboai/piper_stacking)** — a bimanual PiperX
robot picking up a red cube and stacking it on a blue cube.

**Prompt:** `stack red cube on blue cube`

## Task & embodiment
- Robot `piperx_bimanual` — 14-D joint state/action (per arm: 6 joints + gripper × 2)
- 3 RGB cameras: `cam_front`, `cam_left_wrist`, `cam_right_wrist` (resized to 224×224)
- Data: 60 demos / 23,087 frames @ 30 Hz, LeRobot v2.1

## Training
- Base: Physical Intelligence `pi0_base` · full fine-tune (no LoRA) · 3.24B params
- 10,000 steps · batch 32 · action_horizon 50 · AdamW · cosine LR (warmup 600 → peak 5e-5 → 5e-6) · EMA 0.99
- State input: continuous · normalization: z-score (mean/std)
- **Final flow-matching train loss: 0.0064**
- Hardware: 1 × NVIDIA RTX PRO 6000 Blackwell (96 GB)

## Contents
- `params/` — EMA inference weights (orbax)
- `assets/piperx_bimanual/norm_stats.json` — normalization stats (baked from this dataset)
- `_CHECKPOINT_METADATA`
- The 29 GB optimizer `train_state/` is intentionally **excluded** (not needed for inference).

## Load & run (openpi)
Requires the piperx-openpi fork (provides `piperx_policy` + the `pi0_piper_stacking` config).

```python
import pathlib
from huggingface_hub import snapshot_download
from openpi.training import config as _config
from openpi.policies import policy_config

ckpt = pathlib.Path(snapshot_download("axiboai/pi0_piper_stacking"))
cfg = _config.get_config("pi0_piper_stacking")
policy = policy_config.create_trained_policy(cfg, ckpt)

# observation = {"observation.images.cam_front": img, ...cam_left_wrist, ...cam_right_wrist,
#                "observation.state": state_14d, "prompt": "stack red cube on blue cube"}
action_chunk = policy.infer(observation)["actions"]   # (50, 14)
```

If `pi0_piper_stacking` is not yet in your `src/openpi/training/config.py`, add:
```python
    TrainConfig(
        name="pi0_piper_stacking",
        model=pi0_config.Pi0Config(pi05=False),
        weight_loader=weight_loaders.CheckpointWeightLoader("gs://openpi-assets/checkpoints/pi0_base/params"),
        data=LeRobotPiperXBimanualDataConfig(
            repo_id="axiboai/piper_stacking",
            base_config=DataConfig(prompt_from_task=True),
            assets=AssetsConfig(asset_id="piperx_bimanual"),
            default_prompt="stack red cube on blue cube",
        ),
        lr_schedule=_optimizer.CosineDecaySchedule(warmup_steps=600, peak_lr=5e-5, decay_steps=9400, decay_lr=5e-6),
        num_train_steps=10000, batch_size=32, save_interval=2500, keep_period=2500,
    ),
```

## Provenance / license
Fine-tuned from Physical Intelligence's `pi0_base` checkpoint via openpi; the weights inherit the
upstream openpi / base-model license. Dataset: axiboai/piper_stacking.