D3-Flash-NPU2 / NOTICE
FastFlowLM's picture
D3-Flash-NPU2: vllm-sr/d3-flash 13dc1cc8, Q4NX (Q4_K GPTQ) for FastFlowLM 1.0.12
cc2c905 verified
Raw History Blame Contribute Delete
335 Bytes
d3-flash (Decision 3.0)
Copyright 2026 vLLM Semantic Router Team
Built on Qwen/Qwen3.5-9B (Apache-2.0).
Modified by the FastFlowLM team: weights quantized to the Q4NX format (Q4_K projections, Q8_0 token embedding) for AMD NPUs and repackaged for FastFlowLM. The readout, decision config, tokenizer and chat template are unmodified.