Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,159 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- robotics
|
| 5 |
+
- imitation-learning
|
| 6 |
+
- robot-manipulation
|
| 7 |
+
- long-horizon-manipulation
|
| 8 |
+
- non-markovian-control
|
| 9 |
+
- rmbench
|
| 10 |
+
- chronos
|
| 11 |
+
- pytorch
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# Chronos RMBench Checkpoints
|
| 15 |
+
|
| 16 |
+
This repository provides official Chronos checkpoints and matching normalization files for RMBench experiments.
|
| 17 |
+
|
| 18 |
+
Chronos is a physics-informed full-history imitation learning framework for non-Markovian long-horizon robot manipulation.
|
| 19 |
+
|
| 20 |
+
Links:
|
| 21 |
+
|
| 22 |
+
- [Project Page](https://chronos-manipulation.github.io/)
|
| 23 |
+
- [arXiv Paper](https://arxiv.org/abs/2606.30318)
|
| 24 |
+
- [GitHub Code](https://github.com/yulinzhouZYL/Chronos)
|
| 25 |
+
|
| 26 |
+
---
|
| 27 |
+
|
| 28 |
+
## Files
|
| 29 |
+
|
| 30 |
+
This repository contains checkpoint and scaler files for multiple RMBench tasks.
|
| 31 |
+
|
| 32 |
+
For each task, the checkpoint and scaler must be used together:
|
| 33 |
+
|
| 34 |
+
```text
|
| 35 |
+
checkpoint file: last.ckpt
|
| 36 |
+
scaler file : scaler_<task_name>_ee_3d.pth
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
For example, for `cover_blocks`:
|
| 40 |
+
|
| 41 |
+
```text
|
| 42 |
+
last.ckpt
|
| 43 |
+
scaler_cover_blocks_ee_3d.pth
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
If a checkpoint is downloaded with a task-specific filename, please rename it to `last.ckpt` after placing it in the expected local checkpoint directory.
|
| 47 |
+
|
| 48 |
+
---
|
| 49 |
+
|
| 50 |
+
## Action Contract
|
| 51 |
+
|
| 52 |
+
These checkpoints use the Chronos RMBench EE-pose action representation.
|
| 53 |
+
|
| 54 |
+
The action is a 16D dual-arm EE pose + gripper vector:
|
| 55 |
+
|
| 56 |
+
```text
|
| 57 |
+
left EE pose : x, y, z, qw, qx, qy, qz
|
| 58 |
+
left gripper : 1 dimension
|
| 59 |
+
right EE pose : x, y, z, qw, qx, qy, qz
|
| 60 |
+
right gripper : 1 dimension
|
| 61 |
+
```
|
| 62 |
+
|
| 63 |
+
The policy should be evaluated with RMBench EE-pose control:
|
| 64 |
+
|
| 65 |
+
```python
|
| 66 |
+
TASK_ENV.take_action(action, action_type="ee")
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
+
These are not qpos replay checkpoints.
|
| 70 |
+
|
| 71 |
+
---
|
| 72 |
+
|
| 73 |
+
## Expected Local Layout
|
| 74 |
+
|
| 75 |
+
Please place each downloaded checkpoint and scaler in the Chronos repository as follows:
|
| 76 |
+
|
| 77 |
+
```text
|
| 78 |
+
RMBench/policy/Chronos/
|
| 79 |
+
βββ scaler_<task_name>_ee_3d.pth
|
| 80 |
+
βββ checkpoints/
|
| 81 |
+
βββ <task_name>/
|
| 82 |
+
βββ EE_16/
|
| 83 |
+
βββ last.ckpt
|
| 84 |
+
```
|
| 85 |
+
|
| 86 |
+
For example, for `cover_blocks`:
|
| 87 |
+
|
| 88 |
+
```text
|
| 89 |
+
RMBench/policy/Chronos/
|
| 90 |
+
βββ scaler_cover_blocks_ee_3d.pth
|
| 91 |
+
βββ checkpoints/
|
| 92 |
+
βββ cover_blocks/
|
| 93 |
+
βββ EE_16/
|
| 94 |
+
βββ last.ckpt
|
| 95 |
+
```
|
| 96 |
+
|
| 97 |
+
---
|
| 98 |
+
|
| 99 |
+
## Evaluation
|
| 100 |
+
|
| 101 |
+
Before evaluation, make sure `RMBench/policy/Chronos/deploy_policy.yml` points to the correct checkpoint and scaler.
|
| 102 |
+
|
| 103 |
+
For `cover_blocks`, use:
|
| 104 |
+
|
| 105 |
+
```yaml
|
| 106 |
+
ckpt_path: "policy/Chronos/checkpoints/cover_blocks/EE_16/last.ckpt"
|
| 107 |
+
scaler_path: "policy/Chronos/scaler_cover_blocks_ee_3d.pth"
|
| 108 |
+
temporal_agg: true
|
| 109 |
+
gpu_id: 0
|
| 110 |
+
```
|
| 111 |
+
|
| 112 |
+
Then run:
|
| 113 |
+
|
| 114 |
+
```bash
|
| 115 |
+
cd RMBench/policy/Chronos
|
| 116 |
+
bash eval.sh cover_blocks demo_clean Chronos 42 0
|
| 117 |
+
```
|
| 118 |
+
|
| 119 |
+
For another task, replace `cover_blocks` with the corresponding RMBench task name and use the matching scaler:
|
| 120 |
+
|
| 121 |
+
```yaml
|
| 122 |
+
ckpt_path: "policy/Chronos/checkpoints/<task_name>/EE_16/last.ckpt"
|
| 123 |
+
scaler_path: "policy/Chronos/scaler_<task_name>_ee_3d.pth"
|
| 124 |
+
temporal_agg: true
|
| 125 |
+
gpu_id: 0
|
| 126 |
+
```
|
| 127 |
+
|
| 128 |
+
---
|
| 129 |
+
|
| 130 |
+
## Important Notes
|
| 131 |
+
|
| 132 |
+
- The checkpoint and scaler must come from the same task.
|
| 133 |
+
- The scaler filename should follow the pattern `scaler_<task_name>_ee_3d.pth`.
|
| 134 |
+
- These checkpoints are for EE-pose control, not qpos replay.
|
| 135 |
+
- Please use the Chronos-compatible `demo_clean.yml` included in the GitHub repository.
|
| 136 |
+
- If offline validation looks reasonable but closed-loop evaluation fails, first check whether `deploy_policy.yml` points to the correct scaler.
|
| 137 |
+
|
| 138 |
+
---
|
| 139 |
+
|
| 140 |
+
## Citation
|
| 141 |
+
|
| 142 |
+
If you find Chronos useful, please cite:
|
| 143 |
+
|
| 144 |
+
```bibtex
|
| 145 |
+
@article{zhou2026chronos,
|
| 146 |
+
title={Chronos: A Physics-Informed Full-History Framework for Non-Markovian Long-Horizon Manipulation},
|
| 147 |
+
author={Zhou, Yulin and Wang, Yimeng and Wang, Nengyu and Xing, Shaojia and Tu, Shiyun and Li, Xiang and Zhang, Jingkai and Jiang, Ningbo and Lin, Yuankai and Yang, Hua and Zeng, Xiangrui and Yin, Zhouping},
|
| 148 |
+
journal={arXiv preprint arXiv:2606.30318},
|
| 149 |
+
year={2026}
|
| 150 |
+
}
|
| 151 |
+
```
|
| 152 |
+
|
| 153 |
+
---
|
| 154 |
+
|
| 155 |
+
## License
|
| 156 |
+
|
| 157 |
+
This checkpoint repository is released for research use.
|
| 158 |
+
|
| 159 |
+
RMBench benchmark components follow the original RMBench license.
|