|
Download README.md from humanoid-benchmark/groot: direct link, hf CLI and curl.
- Browser
- Download file 8.41 kB
-
https://huggingface.co/humanoid-benchmark/groot/resolve/main/README.md
- Command line
-
hf download hf://humanoid-benchmark/groot/README.md
-
curl -L -o README.md https://huggingface.co/humanoid-benchmark/groot/resolve/main/README.md
8.41 kB
| tags: | |
| - robotics | |
| - humanoid | |
| - imitation-learning | |
| # GR00T N1.7 β Humanoid Benchmark | |
| GR00T N1.7 (Gr00tN1d7) checkpoints fine-tuned on Humanoid Benchmark tasks (action head fine-tuned, VLM backbone frozen). The VLM backbone `nvidia/Cosmos-Reason2-2B` is loaded from its own (gated) repository. | |
| ## Checkpoints | |
| 100 demonstrations per task. Every row is one training run; the epoch folders are its published checkpoints. | |
| | Folder | Task | Robot | Cameras (model input) | Global batch | Proprio augmentation | Checkpoints | | |
| |---|---|---|---|---|---|---| | |
| | `b6-pedal-bin/` | B6 β pick up a chip barrel, step on the pedal bin, drop it in | Unitree G1 (Inspire hands) | ego_view, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `b6-pedal-bin/b256/` | B6 β pick up a chip barrel, step on the pedal bin, drop it in (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| | `a3-fridge-open/` | A3 β open the fridge door | Unitree G1 (Inspire hands) | ego_view, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `a3-fridge-open/b256/` | A3 β open the fridge door (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020`, `step-002000`, `step-004000` | | |
| | `a7-cabinet-close/` | A7 β close the cabinet door | Unitree G1 (Inspire hands) | ego_view, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `a7-cabinet-close/b256/` | A7 β close the cabinet door (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020`, `step-002000`, `step-004000` | | |
| | `a1-ground-object-pickup/` | A1 β walk to a carton on the floor, squat, pick it up with the right hand and walk two steps | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| | `a7-cabinet-close-v2/b512/` | A7 β close the open cabinet door with the right hand (data v2) (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 512 | aligned (GR00T A20 recipe) | `step-002000`, `step-002500`, `step-003000`, `step-003500`, `step-004000` | | |
| | `b8-table-wipe/b512/` | B8 β wipe the tabletop with a flat block held in the right hand (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 512 | aligned (GR00T A20 recipe) | `step-002000`, `step-002500`, `step-003000`, `step-003500`, `step-004000` | | |
| | `a6-door-pull/` | A6 β pull a door open | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020`, `step-002000`, `step-004000` | | |
| | `b7-green-clothes-hamper/b512/` | B7 β take the green garment off the stand and drop it into the hamper (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 512 | aligned (GR00T A20 recipe) | `step-002000`, `step-002500`, `step-003000`, `step-003500`, `step-004000` | | |
| | `a10-trolley-push/` | A10 β push a trolley | Unitree G1 (Inspire hands) | ego_view, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `a20-basket-transfer/` | A20 β transfer a basket | Unitree G1 (Inspire hands) | ego_view, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `a20-basket-transfer/b256/` | A20 β transfer a basket (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| | `a20-basket-transfer/b512/` | A20 β transfer a basket (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 512 | aligned (GR00T A20 recipe) | `step-002000`, `step-002500`, `step-003000`, `step-003500`, `step-004000` | | |
| | `b7-black-clothes-hamper/` | B7 β take the black garment off the hanger and drop it into the hamper | Unitree G1 (Inspire hands) | ego_view, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `b7-black-clothes-hamper/b256/` | B7 β take the black garment off the hanger and drop it into the hamper (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| | `b7-black-clothes-hamper/b512/` | B7 β take the black garment off the hanger and drop it into the hamper (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 512 | aligned (GR00T A20 recipe) | `step-002000`, `step-002500`, `step-003000`, `step-003500`, `step-004000` | | |
| | `c6-bathroom-door-fetch/` | C6 β open the bathroom door, take the tea bottle from the vanity, put it on the dining table | Unitree G1 (Inspire hands) | ego_view, chest | 256 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020`, `step-002000`, `step-004000` | | |
| | `c6-bathroom-door-fetch/b512/` | C6 β open the bathroom door, take the tea bottle from the vanity, put it on the dining table (re-train, current protocol) | Unitree G1 (Inspire hands) | ego_view, chest | 512 | aligned (GR00T A20 recipe) | `step-004000`, `step-004500`, `step-005000`, `step-005500`, `step-006000`, `step-006500`, `step-007000`, `step-007500`, `step-008000` | | |
| | `a18-pour-water/` | A18 β pour water from a pitcher into a glass | H2 (Sharpa hands) | head, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `a18-pour-water/b256/` | A18 β pour water from a pitcher into a glass (re-train, current protocol) | H2 (Sharpa hands) | head, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| | `a17-unscrew-bottle/` | A17 β unscrew the cap of a bottle | H2 (Sharpa hands) | head, chest | 696 | aligned (GR00T A20 recipe) | `epoch-010`, `epoch-020` | | |
| | `a17-unscrew-bottle/b256/` | A17 β unscrew the cap of a bottle (re-train, current protocol) | H2 (Sharpa hands) | head, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| | `a14-unscrew-bulb/` | A14 β insert a bulb into the socket and screw it in until it lights up | H2 (Sharpa hands) | head, chest | 256 | aligned (GR00T A20 recipe) | `step-002000`, `step-004000` | | |
| A `bNNN/` sub-folder (NNN = its global batch, e.g. `b256/`, `b512/`) is a re-train of that task under the current benchmark protocol (2026-11-12: global | |
| batch GR00T / pi0.5 / Delta Flow / ACT 256, Psi-Zero 512, DiT4DiT 64; proprioception augmentation aligned with the | |
| GR00T A20 recipe) and is the one to use for that task; the checkpoints directly under the task folder are the earlier | |
| training round, kept for reference. | |
| ## What an epoch folder contains | |
| Every checkpoint folder (`epoch-XXX/`, or `step-XXXXXX/` for runs trained for a fixed number of steps) is self-contained for evaluation and deployment: weights, model configuration, normalization | |
| statistics and `protocol.json` (task, data, input/output dimensions, cameras, batch, steps, augmentation, file list). | |
| Simple training records are included for reproducibility (training plan, training log, configs, metrics); optimizer / | |
| scheduler / RNG / DeepSpeed resume state is not. `code/` holds the adapter code used for training and inference | |
| (`code/VERSIONS.json`: upstream commits and package versions). | |
| ## Inputs and augmentation | |
| Model inputs are identical across all benchmark models: G1 state 44-D (29 body joint angles + 6 + 6 measured hand values | |
| + 3 projected gravity), H2 state 78-D (75 joint angles + 3 projected gravity), no joint velocities. Cameras: G1 ego view + | |
| chest; H2 head + chest (the 3-camera re-trains of 2026-11-12/13 also used the right-wrist camera; the `protocol.json` of each folder lists its cameras). The third-person camera recorded in the datasets is for data review | |
| only and is never a model input. Each camera is a separate image input, except for Delta Flow and DiT4DiT, which | |
| place the views side by side in one frame. | |
| Training uses the Humanoid Benchmark online data augmentation spec v2 (15 photometric / geometric / sensor / lighting | |
| effects, one of them boosted to 1.5x per sample) with the model's own image augmentation turned off, plus joint-angle | |
| bias and noise on the proprioception (column "Proprio augmentation"; the earlier recipe also delayed the | |
| proprioception and dropped action-history rows). | |
| Earlier repository states are kept in the git history (e.g. revision `2e8f375584631cae0454911e58b5b7850ea9f678`, an older batch setting). | |