README.md

---
title: LabVLA
emoji: 🧪
colorFrom: indigo
colorTo: blue
sdk: gradio
sdk_version: 6.15.1
app_file: app.py
short_description: VLA model for scientific laboratory robotics
python_version: "3.12"
startup_duration_timeout: 1h
---

# LabVLA: Vision-Language-Action Model for Scientific Laboratories

LabVLA is the first VLA foundation model designed specifically for scientific laboratory environments.
It combines a **Qwen3-VL-4B** vision-language backbone with a **DiT flow-matching action expert** trained
with the π0.5 recipe: FAST action-token pre-training → flow-matching post-training with knowledge isolation.

This demo lets you provide a laboratory camera view and a natural language instruction, and the model
predicts a chunk of 50 future robot actions (7 arm joint angles + 1 gripper width per step) for a Franka
Panda manipulator.

## Model

- **Model**: [zjunlp/LabVLA-5B-Base](https://huggingface.co/zjunlp/LabVLA-5B-Base)
- **Paper**: [LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories](https://huggingface.co/papers/2606.13578)
- **GitHub**: [zjunlp/LabVLA](https://github.com/zjunlp/LabVLA)

## Inputs

- **Camera View**: An image of the laboratory workspace
- **Task Instruction**: Natural language instruction (e.g., "Pick up the beaker")
- **Robot State**: 7 arm joint angles + 1 gripper width (Franka Panda 7-DOF)

## Outputs

- **Action Trajectory**: 50-step predicted action chunk visualized as per-joint trajectory plots
- **Action Details**: JSON with the raw action values and timing information