Darkhn/Magistral-2509-24B-Animus-V12.1
#1453
by
FrescoHF
- opened
Will i1-IQ4_XS be better than i1-Q4_0, i1-Q4_K_S, i1-Q4_K_M, and i1-Q4_1?
The model is unfortunately gated. I requested access but no idea if and when they accept my request.
Regarding the quant quality here a table of the requested quants copied from https://hf.tst.eu/model#Kimi-K2-Instruct-GGUF which is based on hundreds of hours of quant quality measurements I made from Qwen2 in Q4 2024. Ideally you would open the linked page and look at the quality column there and interact with the different quant quality metric to come to your own conclusions.
| Quality | Quant |
|---|---|
| 88 | i1-Q4_K_M |
| 86 | i1-Q4_K_S |
| 85 | i1-IQ4_XS |
| 84 | i1-Q4_1 |
| 79 | i1-Q4_0 |