Add C++ and Python low-latency inference docs
Browse files
README.md
CHANGED
|
@@ -176,6 +176,8 @@ pip install huggingface_hub
|
|
| 176 |
python download_from_hf.py --low-latency
|
| 177 |
```
|
| 178 |
|
|
|
|
|
|
|
| 179 |
Simulation:
|
| 180 |
|
| 181 |
```bash
|
|
@@ -201,6 +203,37 @@ cd gear_sonic_deploy
|
|
| 201 |
`_encoder.onnx` and `_decoder.onnx` internally. For the full VLA deployment
|
| 202 |
flow, see the [VLA Inference guide](https://nvlabs.github.io/GR00T-WholeBodyControl/tutorials/vla_inference.html).
|
| 203 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 204 |
## Documentation
|
| 205 |
|
| 206 |
📚 **[Full Documentation](https://nvlabs.github.io/GR00T-WholeBodyControl/)**
|
|
|
|
| 176 |
python download_from_hf.py --low-latency
|
| 177 |
```
|
| 178 |
|
| 179 |
+
### C++ deployment
|
| 180 |
+
|
| 181 |
Simulation:
|
| 182 |
|
| 183 |
```bash
|
|
|
|
| 203 |
`_encoder.onnx` and `_decoder.onnx` internally. For the full VLA deployment
|
| 204 |
flow, see the [VLA Inference guide](https://nvlabs.github.io/GR00T-WholeBodyControl/tutorials/vla_inference.html).
|
| 205 |
|
| 206 |
+
### Python launcher
|
| 207 |
+
|
| 208 |
+
The Python VLA launcher can start the same low-latency C++ deployment pane and
|
| 209 |
+
run the Python VLA client, keyboard publisher, and optional data exporter:
|
| 210 |
+
|
| 211 |
+
```bash
|
| 212 |
+
python gear_sonic/scripts/launch_inference.py \
|
| 213 |
+
--deploy-checkpoint policy/low_latency/model \
|
| 214 |
+
--deploy-obs-config policy/low_latency/observation_config.yaml \
|
| 215 |
+
--camera-host 192.168.123.164 \
|
| 216 |
+
--prompt "pick up the cup"
|
| 217 |
+
```
|
| 218 |
+
|
| 219 |
+
### Python checkpoint evaluation
|
| 220 |
+
|
| 221 |
+
For Isaac Lab evaluation or rendering from the released PyTorch checkpoint:
|
| 222 |
+
|
| 223 |
+
```bash
|
| 224 |
+
python download_from_hf.py --training --low-latency
|
| 225 |
+
python download_from_hf.py --sample
|
| 226 |
+
|
| 227 |
+
python gear_sonic/eval_agent_trl.py \
|
| 228 |
+
+checkpoint=low_latency/last.pt \
|
| 229 |
+
+headless=False \
|
| 230 |
+
++num_envs=1 \
|
| 231 |
+
++manager_env.observations.policy.enable_corruption=False \
|
| 232 |
+
++manager_env.observations.tokenizer.enable_corruption=False \
|
| 233 |
+
"++manager_env.commands.motion.motion_lib_cfg.motion_file=sample_data/robot_filtered" \
|
| 234 |
+
"++manager_env.commands.motion.motion_lib_cfg.smpl_motion_file=sample_data/smpl_filtered"
|
| 235 |
+
```
|
| 236 |
+
|
| 237 |
## Documentation
|
| 238 |
|
| 239 |
📚 **[Full Documentation](https://nvlabs.github.io/GR00T-WholeBodyControl/)**
|