Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +29 -1
README.md CHANGED
@@ -1 +1,29 @@
1
- arxiv.org/abs/2603.27027
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-generation
4
+ ---
5
+
6
+ # TAPS: Task-Aware Proposal Distributions for Speculative Sampling
7
+
8
+ This repository contains artifacts for **TAPS**, a study exploring how draft training distributions shape the quality and efficiency of speculative decoding.
9
+
10
+ - **Paper:** [TAPS: Task Aware Proposal Distributions for Speculative Sampling](https://huggingface.co/papers/2603.27027)
11
+ - **GitHub Repository:** [Moe-Zbeeb/TAPS](https://github.com/Moe-Zbeeb/TAPS)
12
+
13
+ ## Description
14
+ TAPS demonstrates that speculative decoding performance depends heavily on the alignment between a draft model's training data and the downstream workload. The project provides lightweight HASS and EAGLE-2 drafters (~0.8B parameters) optimized for specific tasks like mathematical reasoning (trained on MathInstruct) or general chat (trained on ShareGPT).
15
+
16
+ ### Key Highlights
17
+ - **Task-aware specialization:** Drafts trained on specific domains significantly outperform generic drafts on corresponding benchmarks (e.g., MathInstruct-trained drafts are strongest on GSM8K).
18
+ - **Inference-time Composition:** The research explores strategies like confidence-based routing and merged-tree verification to combine specialized drafters at inference time, outperforming weight-space averaging.
19
+ - **Architectures:** Provides implementations and weights for HASS and EAGLE-2 drafters used to accelerate the `Meta-Llama-3-8B-Instruct` target model.
20
+
21
+ ## Citation
22
+ ```bibtex
23
+ @article{zbib2026taps,
24
+ title={TAPS: Task Aware Proposal Distributions for Speculative Sampling},
25
+ author={Zbib, Mohamad and Bazzi, Mohamad and Mohanna, Ammar and Ghanem, Bernard and Hammoud, Hasan Abed Al Kader},
26
+ year={2026},
27
+ note={Technical report}
28
+ }
29
+ ```