Alibaba-DAMO-Academy/RynnBrain-Plan-8B

RynnBrain: Open Embodied Foundation Models

If you like our project, please give us a star ⭐ on Github for the latest update.

---

📰 News

• [2026.02.02] Release RynnBrain family weights and inference code.
• [2026.02.02] Add cookbooks for cognition, localization, reasoning, and planning.

✨ Introduction

RynnBrain aims to serve as a physics-aware embodied brain: it observes egocentric scenes, grounds language to physical space and time, and supports downstream robotic systems with reliable localization and planning outputs.

Key Highlights

• Comprehensive egocentric understanding
  Strong spatial comprehension and egocentric cognition across embodied QA, counting, OCR, and fine-grained video understanding.

• Diverse spatiotemporal localization
  Locates objects, target areas, and predicts trajectories across long episodic context, enabling global spatial awareness.

• Physical-space grounded reasoning (RynnBrain family)
  The broader RynnBrain family includes “Thinking” variants that interleave textual reasoning with spatial grounding to anchor reasoning in reality.

• Physics-aware precise planning (RynnBrain family)
  Integrates localized affordances/areas/objects into planning outputs to provide downstream VLA models with precise instructions.

🌎 Model Zoo

Model	Base Model	Huggingface	Modelscope
RynnBrain-2B	Qwen3-VL-2B-Instruct	Link	Link
RynnBrain-8B	Qwen3-VL-8B-Instruct	Link	Link
RynnBrain-30B-A3B	Qwen3-VL-30B-A3B-Instruct	Link	Link
RynnBrain‑CoP-8B	RynnBrain-8B	Link	Link
RynnBrain‑Plan-8B (This Checkpoint)	RynnBrain-8B	Link	Link
RynnBrain‑Plan-30B-A3B	RynnBrain-30B-A3B	Link	Link
RynnBrain‑Nav-8B	RynnBrain-8B	Link	Link

🚀 Main Results

🤖 Quick Start

Minimal dependencies:

pip install transformers==4.57.1

Run text generation:

from transformers import AutoModelForImageTextToText
model = AutoModelForImageTextToText.from_pretrained("")
...

Cookbooks

Checkout the cookbooks that showcase RynnBrain's capabilities in cognition, localization, reasoning, and planning.

Category	Cookbook name	Description
Planning	10_manipulate_planning.ipynb	Performs multi-step task decomposition and action planning from goals and scenes.