High-standard model card (FlashDrive); NVIDIA non-commercial license
Browse files
README.md
CHANGED
|
@@ -1,76 +1,69 @@
|
|
| 1 |
---
|
| 2 |
-
pipeline_tag: robotics
|
| 3 |
-
library_name: transformers
|
| 4 |
license: other
|
|
|
|
|
|
|
|
|
|
| 5 |
language:
|
| 6 |
- en
|
|
|
|
| 7 |
base_model:
|
| 8 |
- nvidia/Alpamayo-R1-10B
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
tags:
|
| 10 |
- flashdrive
|
| 11 |
- autonomous-driving
|
| 12 |
- vision-language-action
|
| 13 |
- alpamayo
|
| 14 |
-
new_version: z-lab/Alpamayo-1.5-10B
|
| 15 |
---
|
| 16 |
|
| 17 |
-
# Alpamayo
|
| 18 |
|
| 19 |
-
[Blog](https://z-lab.ai/projects/flashdrive/) | [
|
| 20 |
|
| 21 |
-
**
|
| 22 |
-
[Alpamayo](https://huggingface.co/nvidia/Alpamayo-1.5-10B), NVIDIA's 10B-parameter
|
| 23 |
-
vision-language-action (VLA) models for autonomous driving. It combines streaming VLM
|
| 24 |
-
inference, [DFlash](https://github.com/z-lab/dflash) speculative reasoning, adaptive action
|
| 25 |
-
caching, [ParoQuant](https://github.com/z-lab/paroquant) W4A8 quantization, and system
|
| 26 |
-
optimizations to accelerate inference while preserving accuracy.
|
| 27 |
|
| 28 |
-
This repository mirrors the weights of
|
| 29 |
-
[nvidia/Alpamayo-R1-10B](https://huggingface.co/nvidia/Alpamayo-R1-10B) and serves as the
|
| 30 |
-
**base checkpoint** of the FlashDrive stack. FlashDrive derives the companion checkpoints
|
| 31 |
-
from this repo id by suffix:
|
| 32 |
|
| 33 |
-
|
|
| 34 |
|---|---|
|
| 35 |
-
| [z-lab/Alpamayo-R1-10B-PARO](https://huggingface.co/z-lab/Alpamayo-R1-10B-PARO) | W4A8 (ParoQuant) language-model weights |
|
| 36 |
-
| [z-lab/Alpamayo-R1-10B-DFlash](https://huggingface.co/z-lab/Alpamayo-R1-10B-DFlash) | DFlash block-diffusion draft model |
|
| 37 |
|
| 38 |
-
##
|
| 39 |
|
| 40 |
-
Install [FlashDrive](https://github.com/z-lab/flashdrive), then load
|
| 41 |
-
the `-PARO` and `-DFlash` companions are derived from it by suffix and fetched automatically:
|
| 42 |
|
| 43 |
```python
|
| 44 |
-
|
| 45 |
|
| 46 |
-
model =
|
| 47 |
|
| 48 |
pred_xyz, pred_rot = model.sample_trajectories_streaming(data)
|
| 49 |
```
|
| 50 |
|
| 51 |
-
The first call per stream only prefills the KV cache and returns `(None, None)`.
|
| 52 |
-
For an end-to-end benchmark on a PhysicalAI-AV clip:
|
| 53 |
|
| 54 |
```bash
|
| 55 |
-
python scripts/infer.py --
|
| 56 |
```
|
| 57 |
|
| 58 |
## Performance
|
| 59 |
|
| 60 |
-
|
| 61 |
|
| 62 |
## License
|
| 63 |
|
| 64 |
-
|
| 65 |
-
[non-commercial license](https://huggingface.co/nvidia/Alpamayo-R1-10B/blob/main/LICENSE).
|
| 66 |
-
The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is MIT.
|
| 67 |
|
| 68 |
## Citation
|
| 69 |
|
| 70 |
```bibtex
|
| 71 |
@article{li2026flashdrive,
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
}
|
| 76 |
```
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
license: other
|
| 3 |
+
license_name: nvidia-license
|
| 4 |
+
license_link: https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE
|
| 5 |
+
pipeline_tag: robotics
|
| 6 |
language:
|
| 7 |
- en
|
| 8 |
+
inference: false
|
| 9 |
base_model:
|
| 10 |
- nvidia/Alpamayo-R1-10B
|
| 11 |
+
new_version: z-lab/Alpamayo-1.5-10B
|
| 12 |
+
datasets:
|
| 13 |
+
- nvidia/PhysicalAI-Autonomous-Vehicles
|
| 14 |
+
- nvidia/PhysicalAI-Autonomous-Vehicles-NuRec
|
| 15 |
tags:
|
| 16 |
- flashdrive
|
| 17 |
- autonomous-driving
|
| 18 |
- vision-language-action
|
| 19 |
- alpamayo
|
|
|
|
| 20 |
---
|
| 21 |
|
| 22 |
+
# Alpamayo 1 (R1) (FlashDrive)
|
| 23 |
|
| 24 |
+
[GitHub](https://github.com/z-lab/flashdrive) | [Blog](https://z-lab.ai/projects/flashdrive/) | [Models](https://huggingface.co/collections/z-lab/flashdrive)
|
| 25 |
|
| 26 |
+
[FlashDrive](https://github.com/z-lab/flashdrive) accelerates [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B) — one of NVIDIA's 10B-parameter vision-language-action models for autonomous driving — by **3.9× with no loss in accuracy**, through streaming inference, [DFlash](https://github.com/z-lab/dflash) speculative reasoning, [ParoQuant](https://github.com/z-lab/paroquant) W4A8 quantization, adaptive action caching, and `torch.compile`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
+
This repository mirrors the weights of [nvidia/Alpamayo-R1-10B](https://huggingface.co/nvidia/Alpamayo-R1-10B) and is the **base checkpoint** of the FlashDrive stack. Loading it pulls the derived companions automatically:
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
+
| Checkpoint | Contents |
|
| 31 |
|---|---|
|
| 32 |
+
| [z-lab/Alpamayo-R1-10B-PARO](https://huggingface.co/z-lab/Alpamayo-R1-10B-PARO) | W4A8 ([ParoQuant](https://github.com/z-lab/paroquant)) language-model weights |
|
| 33 |
+
| [z-lab/Alpamayo-R1-10B-DFlash](https://huggingface.co/z-lab/Alpamayo-R1-10B-DFlash) | [DFlash](https://github.com/z-lab/dflash) block-diffusion draft model |
|
| 34 |
|
| 35 |
+
## Usage
|
| 36 |
|
| 37 |
+
Install [FlashDrive](https://github.com/z-lab/flashdrive), then load this base checkpoint — the `-PARO` and `-DFlash` companions are fetched automatically:
|
|
|
|
| 38 |
|
| 39 |
```python
|
| 40 |
+
import flashdrive
|
| 41 |
|
| 42 |
+
model = flashdrive.from_pretrained("z-lab/Alpamayo-R1-10B")
|
| 43 |
|
| 44 |
pred_xyz, pred_rot = model.sample_trajectories_streaming(data)
|
| 45 |
```
|
| 46 |
|
| 47 |
+
The first call per stream only prefills the KV cache and returns `(None, None)`; every later window returns trajectories. For an end-to-end benchmark on a PhysicalAI-AV clip:
|
|
|
|
| 48 |
|
| 49 |
```bash
|
| 50 |
+
python scripts/infer.py --model-path z-lab/Alpamayo-R1-10B
|
| 51 |
```
|
| 52 |
|
| 53 |
## Performance
|
| 54 |
|
| 55 |
+
On a single RTX PRO 6000, FlashDrive runs Alpamayo 1 (R1) at **3.9× lower latency** (824 → 211 ms per window) while minADE improves from 1.913 to 1.850. See the [repository](https://github.com/z-lab/flashdrive#performance) for the full benchmark.
|
| 56 |
|
| 57 |
## License
|
| 58 |
|
| 59 |
+
The Alpamayo weights in this repository are released by NVIDIA under the [NVIDIA License](https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE), which permits **non-commercial use only** and extends to derivative works. The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is separately released under the [MIT License](https://github.com/z-lab/flashdrive/blob/main/LICENSE).
|
|
|
|
|
|
|
| 60 |
|
| 61 |
## Citation
|
| 62 |
|
| 63 |
```bibtex
|
| 64 |
@article{li2026flashdrive,
|
| 65 |
+
title = {{FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving}},
|
| 66 |
+
author = {Li, Zekai and Liang, Yihao and Zhang, Hongfei and Chen, Jian and Liang, Yesheng and Liu, Zhijian},
|
| 67 |
+
year = {2026}
|
| 68 |
}
|
| 69 |
```
|