Zhengyiluo commited on
Commit
5e22ddc
·
verified ·
1 Parent(s): 8756549

Add C++ and Python low-latency inference docs

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -176,6 +176,8 @@ pip install huggingface_hub
176
  python download_from_hf.py --low-latency
177
  ```
178
 
 
 
179
  Simulation:
180
 
181
  ```bash
@@ -201,6 +203,37 @@ cd gear_sonic_deploy
201
  `_encoder.onnx` and `_decoder.onnx` internally. For the full VLA deployment
202
  flow, see the [VLA Inference guide](https://nvlabs.github.io/GR00T-WholeBodyControl/tutorials/vla_inference.html).
203
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
204
  ## Documentation
205
 
206
  📚 **[Full Documentation](https://nvlabs.github.io/GR00T-WholeBodyControl/)**
 
176
  python download_from_hf.py --low-latency
177
  ```
178
 
179
+ ### C++ deployment
180
+
181
  Simulation:
182
 
183
  ```bash
 
203
  `_encoder.onnx` and `_decoder.onnx` internally. For the full VLA deployment
204
  flow, see the [VLA Inference guide](https://nvlabs.github.io/GR00T-WholeBodyControl/tutorials/vla_inference.html).
205
 
206
+ ### Python launcher
207
+
208
+ The Python VLA launcher can start the same low-latency C++ deployment pane and
209
+ run the Python VLA client, keyboard publisher, and optional data exporter:
210
+
211
+ ```bash
212
+ python gear_sonic/scripts/launch_inference.py \
213
+ --deploy-checkpoint policy/low_latency/model \
214
+ --deploy-obs-config policy/low_latency/observation_config.yaml \
215
+ --camera-host 192.168.123.164 \
216
+ --prompt "pick up the cup"
217
+ ```
218
+
219
+ ### Python checkpoint evaluation
220
+
221
+ For Isaac Lab evaluation or rendering from the released PyTorch checkpoint:
222
+
223
+ ```bash
224
+ python download_from_hf.py --training --low-latency
225
+ python download_from_hf.py --sample
226
+
227
+ python gear_sonic/eval_agent_trl.py \
228
+ +checkpoint=low_latency/last.pt \
229
+ +headless=False \
230
+ ++num_envs=1 \
231
+ ++manager_env.observations.policy.enable_corruption=False \
232
+ ++manager_env.observations.tokenizer.enable_corruption=False \
233
+ "++manager_env.commands.motion.motion_lib_cfg.motion_file=sample_data/robot_filtered" \
234
+ "++manager_env.commands.motion.motion_lib_cfg.smpl_motion_file=sample_data/smpl_filtered"
235
+ ```
236
+
237
  ## Documentation
238
 
239
  📚 **[Full Documentation](https://nvlabs.github.io/GR00T-WholeBodyControl/)**