File size: 7,706 Bytes
a8cf27d 08af21c a8cf27d 08af21c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 | ---
datasets:
- StarVLA/RoboTwin-Clean
language:
- en
license: other
license_name: dinov3-license
license_link: https://huggingface.co/H-EmbodVis/TurboVLA/blob/main/DINOv3_LICENSE.md
pipeline_tag: robotics
tags:
- robotics
- embodied-ai
- vision-language-action
- robot-manipulation
- pytorch
- safetensors
- dinov3
- libero
- robotwin
arxiv: "2607.27205"
---
<h1 align="center">TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM</h1>
<div align="center">
<a href="https://arxiv.org/abs/2607.27205"><img src="https://img.shields.io/badge/arXiv-Paper-b31b1b?logo=arxiv" alt="Paper"></a>
<a href="https://h-embodvis.github.io/TurboVLA/"><img src="https://img.shields.io/badge/Homepage-Project-orange.svg?logo=googlehome" alt="Project page"></a>
<a href="https://github.com/H-EmbodVis/TurboVLA"><img src="https://img.shields.io/badge/GitHub-Repository-green?logo=github" alt="GitHub repository"></a>
<a href="https://huggingface.co/H-EmbodVis/TurboVLA/blob/main/DINOv3_LICENSE.md"><img src="https://img.shields.io/badge/Weights-DINOv3%20License-blue" alt="DINOv3 License"></a>
<h5><em>Hengyi Xie<sup>1*</sup>, Chenfei Yao<sup>1*</sup>, Xianjin Wu<sup>1</sup>, Xuanyang Xi<sup>2</sup>, Yiping Tang<sup>2</sup>, Di Xu<sup>2</sup>, Yingying Zhu<sup>1</sup>, Dingkang Liang<sup>1†</sup>, Xiang Bai<sup>1</sup>, Han Ding<sup>1</sup></em></h5>
<sup>1</sup> Huazhong University of Science and Technology, China<br>
<sup>2</sup> Huawei Technologies Co. Ltd, China<br>
<sup>*</sup> Equal contribution, listed alphabetically by surname. <sup>†</sup> Project lead.
</div>
## π Overview
**TurboVLA** is a real-time vision-language-action model for robotic manipulation. It replaces the conventional LLM-centric vision-to-language-to-action pathway with a direct vision-plus-language-to-action design: visual observations and language instructions are encoded independently, exchanged through lightweight bidirectional interaction, and decoded into continuous action chunks.
This repository contains the official TurboVLA checkpoints for the **LIBERO** and **RoboTwin 2.0** evaluations.
<details>
<summary><b>Abstract</b></summary>
Vision-language-action (VLA) models commonly adopt an LLM-centric V β L β A pathway, where visual observations are projected into the representation space of a large language model before being decoded into robot actions. Although effective, this design incurs substantial computation and memory overhead at every policy invocation. In this work, we introduce TurboVLA, a new VLA paradigm that reformulates the conventional V β L β A pathway as a direct V + L β A mapping. Instead of using a large language model as the central interface between perception and action, TurboVLA independently encodes visual observations and language instructions, directly exchanges information between them through lightweight bidirectional vision-language interaction, and predicts continuous action chunks with a compact decoder. This simple design constructs task-conditioned representations directly from visual and linguistic features, significantly reducing the computational and memory costs of VLA inference. On LIBERO, TurboVLA achieves 97.7% average success with only 0.2B parameters, 31.2 ms inference latency, and 0.9 GB inference VRAM on a consumer-grade RTX 4090, matching or outperforming substantially larger VLA policies. These results establish TurboVLA as a simple and effective alternative to the prevailing LLM-centric VLA paradigm, offering a new perspective on how vision, language, and action can be connected for efficient robotic manipulation.
</details>
### β¨ Key Ideas
- Direct vision-plus-language-to-action modeling without an LLM-centric action pathway.
- Independent DINOv3 visual and BERT language encoders with lightweight bidirectional interaction.
- Compact action-chunk decoders for low-latency and memory-efficient inference.
- Official checkpoints for both LIBERO and RoboTwin 2.0.
## π― Task, Inputs, and Outputs
TurboVLA predicts continuous robot action chunks from synchronized multi-view RGB observations, a natural-language instruction, and the robot proprioceptive state.
| Benchmark | Inputs | Output | Action horizon | Visual encoder |
| --- | --- | --- | ---: | --- |
| LIBERO | Two RGB views, language instruction, robot state | 7-D continuous actions | 12 | DINOv3 ViT-B |
| RoboTwin 2.0 | Three 224 x 224 RGB views, language instruction, 14-D robot state | 14-D absolute joint-position actions | 50 | DINOv3 ViT-L |
## π¦ Released Checkpoints
### LIBERO
The LIBERO model was jointly trained on all four suites in a single mixed-suite training run. The released evaluation uses the following suite-specific checkpoints:
| Suite | Evaluation name | Checkpoint |
| --- | --- | --- |
| LIBERO-Object | `libero_object` | `checkpoints/libero/object.pth` |
| LIBERO-Goal | `libero_goal` | `checkpoints/libero/goal.pth` |
| LIBERO-Spatial | `libero_spatial` | `checkpoints/libero/spatial.pth` |
| LIBERO-Long | `libero_10` | `checkpoints/libero/long.pth` |
The LIBERO files are model-state-only PyTorch checkpoints. Optimizer and scheduler states were removed; the released `model_state_dict` tensors are unchanged and are compatible with the official TurboVLA loader.
### RoboTwin 2.0
| Training data | Weights | Checkpoint |
| --- | --- | --- |
| RoboTwin Clean, 50 tasks | EMA | `checkpoints/robotwin/` |
## π οΈ Usage
You can download the complete model repository using either the Hugging Face CLI or the Python SDK.
**Option 1: Hugging Face CLI (Recommended)**
```bash
pip install -U huggingface_hub
hf download H-EmbodVis/TurboVLA --local-dir TurboVLA-model
```
**Option 2: Python SDK**
```python
from huggingface_hub import snapshot_download
snapshot_download(
repo_id="H-EmbodVis/TurboVLA",
repo_type="model",
local_dir="TurboVLA-model",
)
```
TurboVLA is a custom PyTorch VLA implementation and is not directly loadable with `transformers.AutoModel.from_pretrained()`. For installation and evaluation instructions, use the [official GitHub repository](https://github.com/H-EmbodVis/TurboVLA).
## π Repository Contents
| Path | Description |
| --- | --- |
| `checkpoints/libero/*.pth` | Four LIBERO suite-specific evaluation checkpoints |
| `checkpoints/robotwin/*.safetensors` | RoboTwin 2.0 EMA checkpoint |
| `libero_all4_stats.json` | Mixed-suite LIBERO normalization statistics |
| `config.yaml` | RoboTwin model and inference configuration |
| `dataset_statistics.json` | RoboTwin state and action normalization statistics |
| `config.json` | Hugging Face model metadata and checkpoint index |
| `CHECKSUMS.sha256` | SHA-256 checksums for all released checkpoints |
| `DINOv3_LICENSE.md` | DINOv3 terms applicable to the released checkpoint parameters |
| `LICENSE` | Apache-2.0 license for the TurboVLA project code |
## βοΈ License
The TurboVLA source code is released under Apache-2.0. The released checkpoints contain parameters derived from DINOv3 and are distributed subject to the included [DINOv3 License](DINOv3_LICENSE.md). Users must comply with all applicable third-party license terms.
## π Citation
If you find this work useful, please consider citing:
```bibtex
@article{xie2026turbovla,
title = {TurboVLA: Real-Time Vision-Language-Action Model at
32 Hz on an RTX 4090 with <1 GB VRAM},
author = {Xie, Hengyi and Yao, Chenfei and Wu, Xianjin and
Xi, Xuanyang and Tang, Yiping and Xu, Di and
Zhu, Yingying and Liang, Dingkang and Bai, Xiang and
Ding, Han},
journal = {arXiv preprint arXiv:2607.27205},
year = {2026}
}
```
|