1.26 MB
27 files
Updated 7 days ago
Name
Size
figures
outputs
poster
src
tests
FINAL_STATUS.json508 Bytes
xet
MANIFEST.sha256.json1.29 kB
xet
README.md859 Bytes
xet
build_logbook.py14.2 kB
xet
make_poster.py5.17 kB
xet
protocol.md4.45 kB
xet
README.md

Reproduction: SPEED-Bench

Paper: SPEED-Bench: A Unified and Diverse Benchmark for Speculative Decoding
OpenReview: https://openreview.net/forum?id=Rl2uQlCoQX
arXiv: https://arxiv.org/abs/2604.09557
Dataset: https://huggingface.co/datasets/nvidia/SPEED-Bench

Structure

  • src/ - source code for reproduction experiments
  • tests/ - unit tests
  • configs/ - configuration files
  • outputs/ - raw experimental outputs
  • figures/ - generated figures
  • artifacts/ - persistent artifacts for logbook
  • logs/ - execution logs

Protocol

See protocol.md for detailed claim-by-claim reproduction plan.

Quick Start

# Dataset verification
python src/verify_dataset.py

# Semantic diversity analysis
python src/analyze_diversity.py

# Toy speculative decoding experiments
python src/minimal_sd.py
Total size
1.26 MB
Files
27
Last updated
Jul 30
Pre-warmed CDN
US EU US EU

Contributors