README.md

---
license: mit
pipeline_tag: robotics
---

<div align="center">

<p align="center">
  <img src="https://raw.githubusercontent.com/zjunlp/LabVLA/main/assets/logo/labvla-symbol.png" width="88" alt="LabVLA symbol" /><img src="https://raw.githubusercontent.com/zjunlp/LabVLA/main/assets/logo/labvla-wordmark.png" height="56" alt="LabVLA" />
</p>

<h3 align="center"> Grounding Vision–Language–Action Models in Scientific Laboratories </h3>

<p align="center">
  <a href="https://huggingface.co/papers/2606.13578">📰HF Paper</a> •
  <a href="https://zjunlp.github.io/LabVLA/">🔥Project Page</a> •
  <a href="https://github.com/zjunlp/LabVLA">💻GitHub Repo</a> •
  <a href="https://huggingface.co/zjunlp/LabVLA">🤗Model</a>
</p>
</div>

---

## Model Description

**LabVLA** is the first vision–language–action (VLA) model designed specifically for scientific laboratory environments, as introduced in [LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories](https://huggingface.co/papers/2606.13578). 

It combines a **Qwen3-VL-4B-Instruct** vision–language backbone with a **DiT flow-matching action expert**. The model is trained using a two-stage recipe:
1. **FAST action token pretraining**: Makes the backbone action-aware.
2. **Flow matching posttraining**: Attaches the DiT action expert under knowledge insulation to enable continuous control.

LabVLA addresses the gap in existing policies that are mostly trained on household data, enabling autonomous execution of scientific protocols involving laboratory instruments and transparent liquids.

## How to Use

### Download

```bash
huggingface-cli download zjunlp/LabVLA --local-dir LabVLA
```

### Deployment

Serve the model over the OpenPI msgpack WebSocket protocol:

```bash
git clone https://github.com/zjunlp/LabVLA.git
cd LabVLA
bash deployment/deploy.sh
```

For training, data preparation, and more details, please refer to the [GitHub repository](https://github.com/zjunlp/LabVLA).

## Citation

```bibtex
@article{ren2026labvla,
  title   = {LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories},
  author  = {Ren, Baochang and Liu, Xinjie and Chen, Xi and Liu, Yanshuo and
             Li, Chenxi and Gao, Daqi and Su, Zeqin and Xing, Jintao and
             Xue, Zirui and Li, Rui and Zhao, Xiangyu and Qiao, Shuofei and
             Pan, Minting and Zuo, Wangmeng and Bai, Lei and Zhou, Dongzhan and
             Zhang, Ningyu and Chen, Huajun},
  journal = {arXiv preprint arXiv:2606.13578},
  year    = {2026}
}
```