D3-Mini-NPU2 / NOTICE
FastFlowLM's picture
D3-Mini-NPU2 for FastFlowLM 1.0.11
887baf9 verified
Raw History Blame Contribute Delete
334 Bytes
d3-mini (Decision 3.0)
Copyright 2026 vLLM Semantic Router Team
Built on Qwen/Qwen3.5-4B (Apache-2.0).
Modified by the FastFlowLM team: weights quantized to the Q4NX format (Q4_K projections, Q8_0 token embedding) for AMD NPUs and repackaged for FastFlowLM. The readout, decision config, tokenizer and chat template are unmodified.