Launch80/Qwopus3.8-27B-Coder-Flash-Int4-baked
Image-Text-to-Text • 28B • Updated • 112
INT4 bake of Jackrong's Qwopus3.8-27B-Coder-Flash for one 32 GB GPU, with the BF16 reference data to score any quant. Study: launch80.com/blog
Note The INT4 checkpoint (baked lm_head + MTP head). Pin a version with --revision v1.0 / v1.1. Study: https://launch80.com/blog/qwopus-coder-int4-bake-study
Note BF16 top-64 reference logits, exact eval token ids, per-item task results, calibration set and scripts: score your own quant on our harness.
Note INT4 DFlash2 drafter used by the v1.1 fast-decode serving profile (k=7, 128k context).
Note The BF16 source model by Jackrong.