inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8
Text Generation • 1B • Updated • 8
Quantized-Drafters
Note Static FP8 W8A8; Gaussian calibration.
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8
Text Generation • 1B • Updated • 7Note Static FP8 W8A8; PerfectBlend calibration.
inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4
Text Generation • 1B • Updated • 74Note NVFP4 W4A4; Gaussian calibration.
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4
Text Generation • 1B • Updated • 75Note NVFP4 W4A4; PerfectBlend calibration.
inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC
Text Generation • 2B • Updated • 11Note FP8_DYNAMIC; data-free.