D3-Lite-NPU2 / NOTICE
FastFlowLM's picture
D3-Lite-NPU2 for FastFlowLM
cd6df2e verified
Raw History Blame Contribute Delete
352 Bytes
d3-lite (Decision 3.0)
Copyright 2026 vLLM Semantic Router Team
Built on Qwen/Qwen3.5-0.8B (Apache-2.0).
Modified by the FastFlowLM team: weights quantized to the Q4NX format (GPTQ-calibrated Q4_K projections, Q8_0 token embedding) for AMD NPUs and repackaged for FastFlowLM. The readout, decision config, tokenizer and chat template are unmodified.