pipeline_tag: robotics
library_name: transformers
license: apache-2.0
Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models
Embodied-R1.5 is a unified Embodied Foundation Model (EFM), built on Qwen3-VL-8B-Instruct, that integrates comprehensive embodied reasoning—including spatial cognition, task planning, error correction, and pointing—within a single architecture.
- Paper: Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models
- Project Page: https://embodied-r.github.io/
- Repository: https://github.com/pickxiguapi/Embodied-R1.5
Model Description
Embodied-R1.5 achieves state-of-the-art performance on 16 out of 24 embodied VLM benchmarks. It introduces a Planner-Grounder-Corrector (PGC) closed-loop framework, allowing the model to autonomously execute and self-correct during long-horizon tasks. Despite having only 8B parameters, it demonstrates strong zero-shot generalization to real-world robots for instruction following, affordance grounding, and articulated object manipulation.
Installation
pip install transformers>=4.57.0 qwen-vl-utils vllm openai pillow
Sample Usage
The following example demonstrates how to use the model for local inference. Note that this requires the inference utilities provided in the official repository.
from inference.hf_example import HuggingFaceClient
client = HuggingFaceClient(model_path="IffYuan/Embodied-R1.5", device_map="auto", dtype="auto")
case = {
"prompt": "How many table lamps are in the image? Select from the following choices.
(A) 0
(B) 2
(C) 1
(D) 3",
"image": "test_assets/sample_2_image.png",
"type": "single_image",
}
result = client.inference(case, max_new_tokens=512)
print(result["generated_text"])
Citation
@article{yuan2026embodiedr15,
title={Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models},
author={Yuan, Yifu and Huang, Yaoting and Yao, Xianze and Li, Yutong and Zhang, Shuoheng and Han, Linqi and Li, Pengyi and Sun, Jiangeng and Jia, Wenting and Zhang, Zhao and Liu, Yuhao and Liao, Ruihao and Hu, Yucheng and Wu, Qiyu and Li, Yuxiao and Dong, Zibin and Ni, Fei and Zheng, Yan and Gu, Shuyang metal, Yi and Tang, Hongyao and Han, Han and Hao, Jianye},
journal={arXiv preprint},
year={2026}
}