Zhengyiluo commited on
Commit
8756549
·
verified ·
1 Parent(s): 183ed69

Document low-latency SONIC release

Browse files
Files changed (1) hide show
  1. README.md +41 -1
README.md CHANGED
@@ -144,6 +144,8 @@ All checkpoints (ONNX format) are available directly in this repository. Inferen
144
  | Policy encoder | `model_encoder.onnx` | Encodes motion reference into latent |
145
  | Policy decoder | `model_decoder.onnx` | Decodes latent into joint actions |
146
  | Kinematic planner | `planner_sonic.onnx` | Real-time locomotion style planner |
 
 
147
 
148
  **Quick download** (requires `pip install huggingface_hub`):
149
 
@@ -157,10 +159,48 @@ Or use the download script from the GitHub repo:
157
  ```bash
158
  python download_from_hf.py # policy + planner (default)
159
  python download_from_hf.py --no-planner # policy only
 
160
  ```
161
 
162
  See the [Download Models guide](https://nvlabs.github.io/GR00T-WholeBodyControl/getting_started/download_models.html) for full instructions.
163
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
164
  ## Documentation
165
 
166
  📚 **[Full Documentation](https://nvlabs.github.io/GR00T-WholeBodyControl/)**
@@ -239,4 +279,4 @@ This work builds upon and acknowledges:
239
 
240
  ## Model Card Contact
241
 
242
- For questions about this model card or responsible AI considerations, contact: [gear-wbc@nvidia.com](mailto:gear-wbc@nvidia.com)
 
144
  | Policy encoder | `model_encoder.onnx` | Encodes motion reference into latent |
145
  | Policy decoder | `model_decoder.onnx` | Decodes latent into joint actions |
146
  | Kinematic planner | `planner_sonic.onnx` | Real-time locomotion style planner |
147
+ | Low-latency policy | `low_latency/model_encoder.onnx`, `low_latency/model_decoder.onnx`, `low_latency/observation_config.yaml` | Reduced-lookahead G1 controller variant |
148
+ | Low-latency PyTorch checkpoint | `low_latency/last.pt` | Training checkpoint and config for the low-latency variant |
149
 
150
  **Quick download** (requires `pip install huggingface_hub`):
151
 
 
159
  ```bash
160
  python download_from_hf.py # policy + planner (default)
161
  python download_from_hf.py --no-planner # policy only
162
+ python download_from_hf.py --low-latency # low-latency policy + planner
163
  ```
164
 
165
  See the [Download Models guide](https://nvlabs.github.io/GR00T-WholeBodyControl/getting_started/download_models.html) for full instructions.
166
 
167
+ ## Low-Latency Inference
168
+
169
+ The low-latency SONIC variant is stored under `low_latency/` and does not
170
+ replace the default top-level policy. To run it with the C++ deployment stack:
171
+
172
+ ```bash
173
+ git clone https://github.com/NVlabs/GR00T-WholeBodyControl.git
174
+ cd GR00T-WholeBodyControl
175
+ pip install huggingface_hub
176
+ python download_from_hf.py --low-latency
177
+ ```
178
+
179
+ Simulation:
180
+
181
+ ```bash
182
+ cd gear_sonic_deploy
183
+ ./deploy.sh \
184
+ --cp policy/low_latency/model \
185
+ --obs-config policy/low_latency/observation_config.yaml \
186
+ sim
187
+ ```
188
+
189
+ Real robot VLA or teleoperation:
190
+
191
+ ```bash
192
+ cd gear_sonic_deploy
193
+ ./deploy.sh \
194
+ --cp policy/low_latency/model \
195
+ --obs-config policy/low_latency/observation_config.yaml \
196
+ --input-type zmq_manager \
197
+ real
198
+ ```
199
+
200
+ `deploy.sh` expects `--cp` to be the shared model prefix and appends
201
+ `_encoder.onnx` and `_decoder.onnx` internally. For the full VLA deployment
202
+ flow, see the [VLA Inference guide](https://nvlabs.github.io/GR00T-WholeBodyControl/tutorials/vla_inference.html).
203
+
204
  ## Documentation
205
 
206
  📚 **[Full Documentation](https://nvlabs.github.io/GR00T-WholeBodyControl/)**
 
279
 
280
  ## Model Card Contact
281
 
282
+ For questions about this model card or responsible AI considerations, contact: [gear-wbc@nvidia.com](mailto:gear-wbc@nvidia.com)