Add model card, pipeline tag, and links to code & paper

README.md

@@ -0,0 +1,83 @@
+---
+license: apache-2.0
+pipeline_tag: text-generation
+---
+
+# JetSpec: Parallel Tree Drafting
+
+JetSpec is an implementation of **parallel tree drafting** for fast LLM speculative decoding inference with up to 10x acceptance length, and 1000+ TPS on coding and math tasks. This repository contains the trained speculative drafting head presented in the paper [JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting](https://huggingface.co/papers/2606.18394).
+
+For more details, code, and optimized inference engine, please visit the [Official GitHub Repository](https://github.com/hao-ai-lab/JetSpec) and the [Project Webpage](https://hao-ai-lab.github.io/JetSpec).
+
+## Method Overview
+
+JetSpec keeps the **one-pass drafting efficiency and restores causal branch conditioning**. The draft head reads fused hidden states from the frozen target and emits per-depth logits in a single parallel pass. Tree construction spends a draft budget over high-probability branches, and the target verifies every node in one batched/tree-masked forward.
+
+## Installation
+
+Create an environment and install the package:
+
+```bash
+pip install -e '.[bench,kernel]'
+```
+
+## Usage
+
+### HF References
+
+```python
+from jetspec import LLM, SamplingParams
+
+llm = LLM("Qwen/Qwen3-8B", attn_implementation="flash_attention_2")
+out = llm.generate(
+    "The three primary colors are",
+    SamplingParams(temperature=0.0, max_new_tokens=64),
+)
+print(out["text"])
+```
+
+### JetSpec Inference Engine
+
+The optimized engine uses paged KV, a Triton tree-attention backend, compiled verification, CUDA graphs, and optional session reuse.
+
+```python
+from jetspec import load_draft_head, DraftHeadTreeDrafter
+from jetspec.inference_engine import JetSpecEngine, SamplingParams
+
+engine = JetSpecEngine(
+    "Qwen/Qwen3-8B",
+    attn_backend="triton_paged_tree_compiled",
+)
+head = load_draft_head("JetSpec/jetspec-qwen3-8b")
+drafter = DraftHeadTreeDrafter(
+    head,
+    target=engine.model,
+    block_size=head.block_size,
+    target_layer_ids=head.target_layer_ids,
+)
+out = engine.generate_tree(
+    "The three primary colors are",
+    drafter,
+    block_size=head.block_size,
+    tree_depth=20,
+    tree_width=7,
+    budget=128,
+    target_layer_ids=head.target_layer_ids,
+    sampling_params=SamplingParams(temperature=0.0, max_new_tokens=64),
+)
+print(out["text"])
+print("tokens per forward:", out["tpf"])
+```
+
+## Citation
+
+```bibtex
+@inproceedings{jetspec2026,
+  title = {JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting},
+  author = {Hu, Lanxiang and Feng, Zhaoxiang and Wu, Yulun and Yuan, Haoran and Zhao, Yujie and Qian, Yu-Yang and Wang, Bojun and Zhao, Peng and Jiang, Daxin and Zhu, Yibo and Rosing, Tajana and Zhang, Hao},
+  year = {2026},
+  url = {https://arxiv.org/abs/2606.18394},
+  eprint = {2606.18394},
+  note = {Preprint}
+}
+```