Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
Paper β’ 2607.12659 β’ Published
Pretrained checkpoints for paper Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference on LIBERO benchmark, used with the Jetson-PI codebase.
This HuggingFace repo bundles two components (do not merge their params/ trees):
| Subdirectory | Role | Size (approx.) |
|---|---|---|
pi05_libero/ |
Οβ.β -LIBERO policy backbone (VLM + action expert) | ~12 GB |
future_correction_module/ |
Trained future correction module (WM step 65000) | ~157 MB |
pi05_libero (included for convenience; see license below).task_index 30β39), global step 65000.L_act, action expert + token reducer)L_cond, future correction module)L_cond + L_act, ΞΌ detached)H=10, K=9, action_encoder=transformer_block, token_reducer=learned_cross_attn..
βββ README.md
βββ config.json
βββ pi05_libero/
β βββ assets/physical-intelligence/libero/norm_stats.json
β βββ params/ # Orbax Οβ.β
weights
βββ future_correction_module/
βββ params/ # Orbax future correction module weights
After cloning the code repo and installing dependencies:
export PI0_CHECKPOINT=/path/to/hf_snapshot/pi05_libero
export WM=/path/to/hf_snapshot/future_correction_module
export PY_SERVER=/path/to/python_with_jax
export PY=/path/to/python
# Evaluation (LIBERO-spatial)
bash scripts/eval_wm_libero_spatial.sh
Or point serve_policy.py directly:
python scripts/serve_policy.py --env LIBERO --port 8000 \
--world-model-checkpoint "${WM}" \
--world-model-token-reducer-kind learned_cross_attn \
--world-model-action-encoder-kind transformer_block \
--async-ae-proprio-source prefix_t \
policy:checkpoint --policy.config pi05_libero --policy.dir "${PI0_CHECKPOINT}"
pip install huggingface_hub
huggingface-cli download <your-org>/jetson-pi-libero-spatial --local-dir ./jetson-pi-libero-spatial
If Jetson-PI or Jetson-PI-Edge helps your research, please cite our paper:
@article{yang2026jetson,
title={Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference},
author={Yang, Zebin and Wang, Qi and Wang, Yunhe and Guo, Xiurui and Yu, Bo and Liu, Shaoshan and Xu, Jiafeng and Dong, Hao and Li, Meng},
journal={arXiv preprint arXiv:2607.12659},
year={2026}
}
pi05_libero/ weights are from Physical Intelligence openpi (Οβ.β
+ Gemma). See LICENSE_GEMMA.txt in the code repo and the openpi license.future_correction_module/ is released under the same terms as the Jetson-PI project.