Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -1 +1,27 @@
1
- arxiv.org/abs/2603.27027
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ ---
6
+
7
+ # TAPS: Task-Aware Proposal Distributions for Speculative Sampling
8
+
9
+ This repository contains the weights for a draft model introduced in the paper [TAPS: Task Aware Proposal Distributions for Speculative Sampling](https://arxiv.org/abs/2603.27027).
10
+
11
+ TAPS (Task-Aware Proposal Distributions for Speculative Sampling) investigates how the training distribution of draft models affects the performance of speculative decoding. The study demonstrates that specialized drafters (like HASS and EAGLE-2) trained on specific domains (such as math or chat) significantly improve acceptance length when matched with the downstream workload.
12
+
13
+ - **Paper:** [TAPS: Task Aware Proposal Distributions for Speculative Sampling](https://arxiv.org/abs/2603.27027)
14
+ - **GitHub Repository:** [Moe-Zbeeb/TAPS](https://github.com/Moe-Zbeeb/TAPS)
15
+
16
+ ## Model Description
17
+ This specific checkpoint is a lightweight LLaMA-style drafter (~0.8B parameters) featuring a single hidden layer. It is designed to be used in conjunction with a larger target model (like Meta-Llama-3-8B-Instruct) to accelerate autoregressive generation via speculative decoding.
18
+
19
+ ## Citation
20
+ ```bibtex
21
+ @article{zbib2026taps,
22
+ title={TAPS: Task Aware Proposal Distributions for Speculative Sampling},
23
+ author={Zbib, Mohamad and Bazzi, Mohamad and Mohanna, Ammar and Ghanem, Bernard and Hammoud, Hasan Abed Al Kader},
24
+ year={2026},
25
+ note={Technical report}
26
+ }
27
+ ```