Qwen

/

Qwen3-Coder-Next-FP8

like 75

Follow

Qwen 69.3k

The below command should run Qwen/Qwen3-Coder-Next-FP8 on 2 GPUs instead of 4

vllm serve Qwen/Qwen3-Coder-Next-FP8 --port 8000 --tensor-parallel-size 2 --enable-auto-tool-choice --tool-call-parser qwen3_coder