Serve (SGLang)
pip install "sglang>=0.5.12"
SGLANG_ENABLE_SPEC_V2=1 python3 -m sglang.launch_server --model-path Qwen/Qwen3.6-27B --speculative-algorithm EAGLE3 --speculative-draft-model-path ./compressed --speculative-num-steps 3 --speculative-eagle-topk 1 --speculative-num-draft-tokens 4 --mamba-scheduler-strategy extra_buffer --mm-attention-backend sdpa --dtype bfloat16 --trust-remote-code
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for VirVen/Qwen3.6-27B-EAGLE3
Base model
Qwen/Qwen3.6-27B