Avesed/Qwen3.6-27B-DSpark

Qwen3.6-27B DSpark draft head

DSpark speculative-decoding draft head for Avesed/Qwen3.6-27B-W4A16, trained on (Dataset )

Requires VLLM version 0.26 or later, or my fork for Ampere GPUs 0.4.1 or later

Serve this head with the vllm-ampere-optimized fork (ghcr.io/avesed/vllm-ampere-optimized:latest).

Accepted length (num_speculative_tokens=7, greedy, 10 prompts/category — robust)

task	accept_len
gsm8k	4.53
code (HumanEval-style)	4.66
math	4.10
chat (EN)	2.59
chat (ZH)	1.73

~2× decode speedup on English; multilingual output verified clean (0 degeneration). Chinese acceleration is modest (the draft head is English-centric); more Chinese on-policy data would raise it.

Serve (Ampere fork)

docker run --runtime nvidia --gpus all --shm-size 8g -p 8000:8000 \
  ghcr.io/avesed/vllm-ampere-optimized:0.3 \
  Avesed/Qwen3.6-27B-W4A16 --tensor-parallel-size 2 --trust-remote-code \
  --speculative-config '{"method":"dspark","model":"Avesed/Qwen3.6-27B-DSpark","num_speculative_tokens":7}'