--- pipeline_tag: robotics library_name: transformers license: apache-2.0 --- # Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models Embodied-R1.5 is a unified Embodied Foundation Model (EFM), built on Qwen3-VL-8B-Instruct, that integrates comprehensive embodied reasoning—including spatial cognition, task planning, error correction, and pointing—within a single architecture. - **Paper:** [Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models](https://huggingface.co/papers/2606.11324) - **Project Page:** [https://embodied-r.github.io/](https://embodied-r.github.io/) - **Repository:** [https://github.com/pickxiguapi/Embodied-R1.5](https://github.com/pickxiguapi/Embodied-R1.5) ## Model Description Embodied-R1.5 achieves state-of-the-art performance on 16 out of 24 embodied VLM benchmarks. It introduces a **Planner-Grounder-Corrector (PGC)** closed-loop framework, allowing the model to autonomously execute and self-correct during long-horizon tasks. Despite having only 8B parameters, it demonstrates strong zero-shot generalization to real-world robots for instruction following, affordance grounding, and articulated object manipulation. ## Installation ```bash pip install transformers>=4.57.0 qwen-vl-utils vllm openai pillow ``` ## Sample Usage The following example demonstrates how to use the model for local inference. Note that this requires the inference utilities provided in the [official repository](https://github.com/pickxiguapi/Embodied-R1.5). ```python from inference.hf_example import HuggingFaceClient client = HuggingFaceClient(model_path="IffYuan/Embodied-R1.5", device_map="auto", dtype="auto") case = { "prompt": "How many table lamps are in the image? Select from the following choices. (A) 0 (B) 2 (C) 1 (D) 3", "image": "test_assets/sample_2_image.png", "type": "single_image", } result = client.inference(case, max_new_tokens=512) print(result["generated_text"]) ``` ## Citation ```bibtex @article{yuan2026embodiedr15, title={Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models}, author={Yuan, Yifu and Huang, Yaoting and Yao, Xianze and Li, Yutong and Zhang, Shuoheng and Han, Linqi and Li, Pengyi and Sun, Jiangeng and Jia, Wenting and Zhang, Zhao and Liu, Yuhao and Liao, Ruihao and Hu, Yucheng and Wu, Qiyu and Li, Yuxiao and Dong, Zibin and Ni, Fei and Zheng, Yan and Gu, Shuyang metal, Yi and Tang, Hongyao and Han, Han and Hao, Jianye}, journal={arXiv preprint}, year={2026} } ```