Add model card info and metadata
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,6 +1,39 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
base_model:
|
| 3 |
- Gen-Verse/MMaDA-8B-Base
|
| 4 |
---
|
| 5 |
|
| 6 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: robotics
|
| 4 |
base_model:
|
| 5 |
- Gen-Verse/MMaDA-8B-Base
|
| 6 |
---
|
| 7 |
|
| 8 |
+
# MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generation
|
| 9 |
+
|
| 10 |
+
[**Project Page**](https://yliu-cs.github.io/MMaDA-VLA) | [**Paper**](https://arxiv.org/abs/2603.25406) | [**GitHub**](https://github.com/yliu-cs/MMaDA-VLA)
|
| 11 |
+
|
| 12 |
+
**MMaDA-VLA** is a fully native pre-trained large diffusion Vision-Language-Action (VLA) model that unifies multi-modal understanding and generation in a single framework. It employs a native discrete diffusion formulation that embeds language, images, and continuous robot controls into one discrete token space.
|
| 13 |
+
|
| 14 |
+
## Model Summary
|
| 15 |
+
MMaDA-VLA trains a single backbone with masked token denoising to jointly generate a future goal observation and an action chunk in parallel. Iterative denoising enables global, order-free refinement, improving long-horizon consistency while grounding actions in predicted future visual outcomes without the need for auxiliary world models.
|
| 16 |
+
|
| 17 |
+
### Key Features
|
| 18 |
+
- **Unified Multi-Modal Space:** Embeds text, vision, and robot actions into a single discrete token space.
|
| 19 |
+
- **Discrete Diffusion Formulation:** Utilizes masked token denoising for parallel generation of actions and future states.
|
| 20 |
+
- **Improved Consistency:** Global refinement via denoising reduces long-horizon error accumulation common in autoregressive models.
|
| 21 |
+
|
| 22 |
+
## Performance
|
| 23 |
+
MMaDA-VLA achieves state-of-the-art performance across major simulation benchmarks:
|
| 24 |
+
- **LIBERO:** 98.0% average success rate.
|
| 25 |
+
- **CALVIN:** 4.78 average task length.
|
| 26 |
+
|
| 27 |
+
## Citation
|
| 28 |
+
If you find MMaDA-VLA useful for your research, please consider citing the following paper:
|
| 29 |
+
|
| 30 |
+
```bibtex
|
| 31 |
+
@article{liu2026mmadavla,
|
| 32 |
+
author = {Yang Liu and Pengxiang Ding and Tengyue Jiang and Xudong Wang and Minghui Lin and Wenxuan Song and Hongyin Zhang and Zifeng Zhuang and Han Zhao and Wei Zhao and Siteng Huang and Jinkui Shi and Donglin Wang},
|
| 33 |
+
title = {{MMaDA-VLA}: Large Diffusion Vision-Language-Action Model with Multimodal Instruction and Generation},
|
| 34 |
+
journal = {CoRR},
|
| 35 |
+
volume = {abs/2603.25406},
|
| 36 |
+
year = {2026},
|
| 37 |
+
url = {https://arxiv.org/abs/2603.25406}
|
| 38 |
+
}
|
| 39 |
+
```
|