Anbeeld commited on
Commit
fb93274
·
verified ·
1 Parent(s): 4192018

Fix README metadata and assets

Browse files
Files changed (1) hide show
  1. README.md +78 -0
README.md ADDED
@@ -0,0 +1,78 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: z-lab/Alpamayo-R1-10B-DFlash
3
+ tags:
4
+ - safetensors
5
+ - qwen3
6
+ - flashdrive
7
+ - dflash
8
+ - speculative-decoding
9
+ - block-diffusion
10
+ - draft-model
11
+ - autonomous-driving
12
+ - vision-language-action
13
+ - robotics
14
+ - en
15
+ - arxiv:2602.06036
16
+ - base_model:z-lab/Alpamayo-R1-10B
17
+ - base_model:finetune:z-lab/Alpamayo-R1-10B
18
+ - license:other
19
+ - region:us
20
+ ---
21
+
22
+ # Alpamayo R1 10B DFlash GGUF
23
+
24
+ GGUF quantizations of [**z-lab DFlash draft model**](https://huggingface.co/z-lab/Alpamayo-R1-10B-DFlash) for [**Alpamayo R1 10B**](https://huggingface.co/z-lab/Alpamayo-R1-10B).
25
+
26
+ Use with [BeeLlama.cpp](https://github.com/Anbeeld/beellama.cpp), a llama.cpp fork with advanced quantization features.
27
+
28
+ ---
29
+
30
+ # Alpamayo 1 (R1) — DFlash draft
31
+
32
+ **Flash Vision-Language-Action Inference for Autonomous Driving**
33
+
34
+ [![Paper](https://img.shields.io/badge/arXiv-2602.06036-b31b1b.svg)](https://arxiv.org/abs/2602.06036)
35
+ [![GitHub](https://img.shields.io/badge/GitHub-FlashDrive-181717?logo=github)](https://github.com/z-lab/flashdrive)
36
+ [![Blog](https://img.shields.io/badge/Blog-FlashDrive-blue)](https://z-lab.ai/projects/flashdrive/)
37
+ [![Models](https://img.shields.io/badge/%F0%9F%A4%97-Models-yellow)](https://huggingface.co/collections/z-lab/flashdrive)
38
+
39
+ [DFlash](https://github.com/z-lab/dflash) draft model for [z-lab/Alpamayo-R1-10B](https://huggingface.co/z-lab/Alpamayo-R1-10B), used by [FlashDrive](https://github.com/z-lab/flashdrive) to accelerate the chain-of-causation reasoning of [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B).
40
+
41
+ DFlash (ICML 2026) uses a lightweight block-diffusion draft to propose several tokens in parallel; the target verifies each block in a single forward, preserving its output distribution. This draft is a 2-layer Qwen3-style network (block size 8) conditioned on target hidden states from layers 24/30/31/32/34. The repository also ships `mask_embedding.pt`, the trained mask-token embedding FlashDrive appends to the target's embedding table.
42
+
43
+ > [!NOTE]
44
+ > **Not a standalone language model.** FlashDrive attaches it to the [base checkpoint](https://huggingface.co/z-lab/Alpamayo-R1-10B) automatically — you do not load this repository directly.
45
+
46
+ ## Usage
47
+
48
+ ```python
49
+ import flashdrive
50
+
51
+ # from_pretrained fetches this -DFlash checkpoint automatically
52
+ model = flashdrive.from_pretrained("z-lab/Alpamayo-R1-10B")
53
+ ```
54
+
55
+ See the [base model card](https://huggingface.co/z-lab/Alpamayo-R1-10B) and the [FlashDrive repository](https://github.com/z-lab/flashdrive) for the full pipeline.
56
+
57
+ ## License
58
+
59
+ This checkpoint is derived from NVIDIA's Alpamayo weights and is governed by the [NVIDIA License](https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE), which permits **non-commercial use only** and extends to derivative works. The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is separately released under the [MIT License](https://github.com/z-lab/flashdrive/blob/main/LICENSE).
60
+
61
+ ## Citation
62
+
63
+ ```bibtex
64
+ @inproceedings{chen2026dflash,
65
+ title = {{DFlash: Block Diffusion for Flash Speculative Decoding}},
66
+ author = {Chen, Jian and Liang, Yesheng and Liu, Zhijian},
67
+ booktitle = {International Conference on Machine Learning (ICML)},
68
+ year = {2026}
69
+ }
70
+ ```
71
+
72
+ ```bibtex
73
+ @article{li2026flashdrive,
74
+ title = {{FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving}},
75
+ author = {Li, Zekai and Liang, Yihao and Zhang, Hongfei and Chen, Jian and Liang, Yesheng and Liu, Zhijian},
76
+ year = {2026}
77
+ }
78
+ ```