EXL3 quants of Ling-3.1-flash
⚠️ Requires ExLlamaV3 v1.6.3 (or dev branch)
Plain quants:
2.10 bits per weight
2.60 bits per weight
3.10 bits per weight
(more bitrates and self-calibrated quants to follow)
Model tree for turboderp/Ling-3.1-flash-exl3
Base model
inclusionAI/Ling-3.1-flash