README.md

---
license: other
license_name: nvidia-license
license_link: https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE
pipeline_tag: robotics
language:
- en
inference: false
base_model:
- z-lab/Alpamayo-R1-10B
tags:
- flashdrive
- dflash
- speculative-decoding
- block-diffusion
- draft-model
- autonomous-driving
- vision-language-action
---

# Alpamayo 1 (R1) — DFlash draft

**Flash Vision-Language-Action Inference for Autonomous Driving**

[![Paper](https://img.shields.io/badge/arXiv-2602.06036-b31b1b.svg)](https://arxiv.org/abs/2602.06036)
[![GitHub](https://img.shields.io/badge/GitHub-FlashDrive-181717?logo=github)](https://github.com/z-lab/flashdrive)
[![Blog](https://img.shields.io/badge/Blog-FlashDrive-blue)](https://z-lab.ai/projects/flashdrive/)
[![Models](https://img.shields.io/badge/%F0%9F%A4%97-Models-yellow)](https://huggingface.co/collections/z-lab/flashdrive)

[DFlash](https://github.com/z-lab/dflash) draft model for [z-lab/Alpamayo-R1-10B](https://huggingface.co/z-lab/Alpamayo-R1-10B), used by [FlashDrive](https://github.com/z-lab/flashdrive) to accelerate the chain-of-causation reasoning of [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B).

DFlash (ICML 2026) uses a lightweight block-diffusion draft to propose several tokens in parallel; the target verifies each block in a single forward, preserving its output distribution. This draft is a 2-layer Qwen3-style network (block size 8) conditioned on target hidden states from layers 24/30/31/32/34. The repository also ships `mask_embedding.pt`, the trained mask-token embedding FlashDrive appends to the target's embedding table.

> [!NOTE]
> **Not a standalone language model.** FlashDrive attaches it to the [base checkpoint](https://huggingface.co/z-lab/Alpamayo-R1-10B) automatically — you do not load this repository directly.

## Usage

```python
import flashdrive

# from_pretrained fetches this -DFlash checkpoint automatically
model = flashdrive.from_pretrained("z-lab/Alpamayo-R1-10B")
```

See the [base model card](https://huggingface.co/z-lab/Alpamayo-R1-10B) and the [FlashDrive repository](https://github.com/z-lab/flashdrive) for the full pipeline.

## License

This checkpoint is derived from NVIDIA's Alpamayo weights and is governed by the [NVIDIA License](https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE), which permits **non-commercial use only** and extends to derivative works. The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is separately released under the [MIT License](https://github.com/z-lab/flashdrive/blob/main/LICENSE).

## Citation

```bibtex
@inproceedings{chen2026dflash,
  title     = {{DFlash: Block Diffusion for Flash Speculative Decoding}},
  author    = {Chen, Jian and Liang, Yesheng and Liu, Zhijian},
  booktitle = {International Conference on Machine Learning (ICML)},
  year      = {2026}
}
```

```bibtex
@article{li2026flashdrive,
  title  = {{FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving}},
  author = {Li, Zekai and Liang, Yihao and Zhang, Hongfei and Chen, Jian and Liang, Yesheng and Liu, Zhijian},
  year   = {2026}
}
```