abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV Image-Text-to-Text • 28B • Updated 11 days ago • 17.9k • 3
Qwen3.8-27B Quantizations (INT4 + FP8-KV) Collection INT4 quantizations of Qwen3.8-27B calibrated at 262k context: AWQ and GPTQ weights, each in bf16-KV and calibrated fp8-e4m3 KV editions. • 4 items • Updated Aug 30
abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV Image-Text-to-Text • 28B • Updated 11 days ago • 17.9k • 3