yulinzhouZYL commited on
Commit
ac5b874
Β·
verified Β·
1 Parent(s): e8a906d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +159 -0
README.md ADDED
@@ -0,0 +1,159 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - robotics
5
+ - imitation-learning
6
+ - robot-manipulation
7
+ - long-horizon-manipulation
8
+ - non-markovian-control
9
+ - rmbench
10
+ - chronos
11
+ - pytorch
12
+ ---
13
+
14
+ # Chronos RMBench Checkpoints
15
+
16
+ This repository provides official Chronos checkpoints and matching normalization files for RMBench experiments.
17
+
18
+ Chronos is a physics-informed full-history imitation learning framework for non-Markovian long-horizon robot manipulation.
19
+
20
+ Links:
21
+
22
+ - [Project Page](https://chronos-manipulation.github.io/)
23
+ - [arXiv Paper](https://arxiv.org/abs/2606.30318)
24
+ - [GitHub Code](https://github.com/yulinzhouZYL/Chronos)
25
+
26
+ ---
27
+
28
+ ## Files
29
+
30
+ This repository contains checkpoint and scaler files for multiple RMBench tasks.
31
+
32
+ For each task, the checkpoint and scaler must be used together:
33
+
34
+ ```text
35
+ checkpoint file: last.ckpt
36
+ scaler file : scaler_<task_name>_ee_3d.pth
37
+ ```
38
+
39
+ For example, for `cover_blocks`:
40
+
41
+ ```text
42
+ last.ckpt
43
+ scaler_cover_blocks_ee_3d.pth
44
+ ```
45
+
46
+ If a checkpoint is downloaded with a task-specific filename, please rename it to `last.ckpt` after placing it in the expected local checkpoint directory.
47
+
48
+ ---
49
+
50
+ ## Action Contract
51
+
52
+ These checkpoints use the Chronos RMBench EE-pose action representation.
53
+
54
+ The action is a 16D dual-arm EE pose + gripper vector:
55
+
56
+ ```text
57
+ left EE pose : x, y, z, qw, qx, qy, qz
58
+ left gripper : 1 dimension
59
+ right EE pose : x, y, z, qw, qx, qy, qz
60
+ right gripper : 1 dimension
61
+ ```
62
+
63
+ The policy should be evaluated with RMBench EE-pose control:
64
+
65
+ ```python
66
+ TASK_ENV.take_action(action, action_type="ee")
67
+ ```
68
+
69
+ These are not qpos replay checkpoints.
70
+
71
+ ---
72
+
73
+ ## Expected Local Layout
74
+
75
+ Please place each downloaded checkpoint and scaler in the Chronos repository as follows:
76
+
77
+ ```text
78
+ RMBench/policy/Chronos/
79
+ β”œβ”€β”€ scaler_<task_name>_ee_3d.pth
80
+ └── checkpoints/
81
+ └── <task_name>/
82
+ └── EE_16/
83
+ └── last.ckpt
84
+ ```
85
+
86
+ For example, for `cover_blocks`:
87
+
88
+ ```text
89
+ RMBench/policy/Chronos/
90
+ β”œβ”€β”€ scaler_cover_blocks_ee_3d.pth
91
+ └── checkpoints/
92
+ └── cover_blocks/
93
+ └── EE_16/
94
+ └── last.ckpt
95
+ ```
96
+
97
+ ---
98
+
99
+ ## Evaluation
100
+
101
+ Before evaluation, make sure `RMBench/policy/Chronos/deploy_policy.yml` points to the correct checkpoint and scaler.
102
+
103
+ For `cover_blocks`, use:
104
+
105
+ ```yaml
106
+ ckpt_path: "policy/Chronos/checkpoints/cover_blocks/EE_16/last.ckpt"
107
+ scaler_path: "policy/Chronos/scaler_cover_blocks_ee_3d.pth"
108
+ temporal_agg: true
109
+ gpu_id: 0
110
+ ```
111
+
112
+ Then run:
113
+
114
+ ```bash
115
+ cd RMBench/policy/Chronos
116
+ bash eval.sh cover_blocks demo_clean Chronos 42 0
117
+ ```
118
+
119
+ For another task, replace `cover_blocks` with the corresponding RMBench task name and use the matching scaler:
120
+
121
+ ```yaml
122
+ ckpt_path: "policy/Chronos/checkpoints/<task_name>/EE_16/last.ckpt"
123
+ scaler_path: "policy/Chronos/scaler_<task_name>_ee_3d.pth"
124
+ temporal_agg: true
125
+ gpu_id: 0
126
+ ```
127
+
128
+ ---
129
+
130
+ ## Important Notes
131
+
132
+ - The checkpoint and scaler must come from the same task.
133
+ - The scaler filename should follow the pattern `scaler_<task_name>_ee_3d.pth`.
134
+ - These checkpoints are for EE-pose control, not qpos replay.
135
+ - Please use the Chronos-compatible `demo_clean.yml` included in the GitHub repository.
136
+ - If offline validation looks reasonable but closed-loop evaluation fails, first check whether `deploy_policy.yml` points to the correct scaler.
137
+
138
+ ---
139
+
140
+ ## Citation
141
+
142
+ If you find Chronos useful, please cite:
143
+
144
+ ```bibtex
145
+ @article{zhou2026chronos,
146
+ title={Chronos: A Physics-Informed Full-History Framework for Non-Markovian Long-Horizon Manipulation},
147
+ author={Zhou, Yulin and Wang, Yimeng and Wang, Nengyu and Xing, Shaojia and Tu, Shiyun and Li, Xiang and Zhang, Jingkai and Jiang, Ningbo and Lin, Yuankai and Yang, Hua and Zeng, Xiangrui and Yin, Zhouping},
148
+ journal={arXiv preprint arXiv:2606.30318},
149
+ year={2026}
150
+ }
151
+ ```
152
+
153
+ ---
154
+
155
+ ## License
156
+
157
+ This checkpoint repository is released for research use.
158
+
159
+ RMBench benchmark components follow the original RMBench license.