--- library_name: transformers --- Q0 Benchmark

🔮 QO Benchmark

Updated: January 8, 2025

Ranks output complexity, censorship, instruction following, alignment, and output quality. **Bolded models are Mistral 24B.** | Model | Score | Quant | Q0G | Refusals | | :--- | :--- | :--- | :--- | :--- | | GLM 4.6 | 28514 | IQ2_M | Fail | N/A | | Ling Flash 2.0 Abliterated | 15628 | Q4_K_M | Fail | 0/100 | | DarkForest 20B v2.0 fp32 upscaled | 13106 | Q6_K | Pass | 21/100 | | **Cydonia v4s** | 11346 | Q8_0 | Pass | 16/100 | | **Checkpoint J (Karcher5A)** | 11320 | Q8_K_XL | Pass | 20/100 | | GLM 4.5 Air Abliterated | 10712 | Q3_K_M | Fail | 0/100 | | DarkForest 20B v2.0 Erebus Edition | 10696 | Q6_K | Fail | 0/100 | | **Cydonia v4r** | 10683 | Q8_0 | Fail | 15/100 | | Gemma 3 27B Abliterated | 10564 | Q8_K_XL | Fail | 0/100 | | Seed OSS 36B Instruct | 10353 | Q4_K_XL | Fail | 42/100 | | Fallen Gemma 3 27B | 9605 | IQ4_XS | Fail | N/A | | **Cydonia v4zg Heretic** | 9355 | Q6_K | N/A | N/A | | **Goetia v1.1 (Checkpoint R20 K10)** | 9331 | Q8_0 | Pass | 19/100 | | **Dark World v1 (Checkpoint R19 K4)** | 9298 | Q8_0 | Pass | 4/100 | | **Goetia v1 (Checkpoint C)** | 8936 | Q8_K_XL | Fail | 24/100 | | **Circuitry v2** | 8445 | Q8_0 | Fail | N/A | | **BlackDolphin** | 8309 | Q8_0 | Fail | 9/100 | | Warlock 7B v2 (v2a) | 8298 | Q8_0 | Pass | 4/100 | | **DolphinMistralVeniceEdition** | 7709 | Q8_0 | Fail | 1/100 | | **Morax v1** | 7656 | Q6_K | Pass | N/A | | **FireDolphin v1** | 7548 | Q8_K_XL | N/A | N/A | | **Mullein v2** | 7545 | Q8_0 | Fail | 6/100 | | Delirium v1 abliterated | 7534 | Q8_0 | Fail | 12/100 | | **BlackSheep** | 7407 | Q8_0 | N/A | 4/100 | | **Evilmind v1** | 6890 | Q6_K | Pass | 2/100 | | **PaintedFantasy v2** | 6867 | Q8_0 | Fail | 25/100 | | Warlock 7B v1 (v0k) | 6664 | Q8_0 | Fail | 8/100 | | **Animus v7.1** | 6199 | Q8_0 | N/A | N/A | **Broken Tutu Transgression v2.0** | 6127 | Q6_K | Fail | N/A | | **Harbinger** | 5805 | IQ4_XS | N/A | N/A | | **MS3.2 Austral Winton** | 5736 | IQ4_XS | N/A | N/A | | Gemma The Writer 9B abliterated | 5726 | Q6_K | Fail | 18/100 | | **Cydonia v4j** | 5664 | Q8_0 | Pass | 22/100 | **Dark Osmosis v1.0** | 5647 | Q6_K | Pass | N/A | | Smilodon 9B v1.0 | 5643 | Q8_0 | Pass | N/A | | **Codex** | 5569 | IQ4_XS | N/A | N/A | | **Cthulhu v1.1** | 5437 | IQ4_XS | N/A | N/A | | **Orochi v0cp6** | 5362 | IQ4_XS | N/A | N/A | | **WeirdCompound v1.6** | 5286 | Q8_0 | Fail | N/A | | **Rivermind v1a** | 5232 | Q6_K | Fail | 12/100 | | FallenGLM4 v1b | 5204 | Q8_0 | Fail | N/A | | **Cthulhu v1.3** | 5152 | IQ4_XS | N/A | N/A | N/A | | **TheOmegaDirective v2.1** | 5110 | IQ4_XS | N/A | N/A | | Spacebound Stock | 5056 | Q6_K | N/A | N/A | | Grok 2 |4962 | IQ1_M | Fail | N/A | | **FallenMistralSmall v1f** | 4954 | Q6_K | Fail | N/A | | **Cthulhu v1.2** | 4913 | IQ4_XS | N/A | N/A | | **FallenMistralSmall v1e** | 4902 | Q8_0 | Pass | 0/100 | | **Eldrinox v1** | 4874 | IQ4_XS | N/A | N/A | | FallenLlama v3.3 R1 | 4789 | IQ4_XS | Fail | N/A | | **Loki v1.3** | 4441 | Q8_0 | N/A | N/A | | FallenGPTOss v1b | 4177 | Q8_0 | Pass | N/A | | **Rei KTO** | 4168 | IQ4_XS | N/A | N/A | | **Mawdistic NightLife** | 4167 | Q6_K | N/A | N/A | | FallenScout v1a | 4163 | Q4_K_M | Pass | N/A | | **Cthulhu v1.0** | 4128 | IQ4_XS | N/A | N/A | | EpicurianTiger 9B v1 | 4092 | Q8_0 | N/A | N/A | | **Eurydice v3.5** | 4069 | IQ4_XS | N/A | N/A | | FallenQwQ v1d | 4065 | Q8_0 | Pass | N/A | | Granite 4.0 h tiny abliterated | 3898 | Q6_K | Fail | N/A | | Amoral Gemma 3 12B v2 | 3784 | QAT Q4_0 | N/A | N/A | | Tiger Gemma 2 9B v3 | 3779 | Q8_0 | Fail | N/A | | Granite 3.3 8B | 3736 | Q8_K_XL | Fail | N/A | | **Austral Winton** | 3736 | IQ4_XS | N/A | N/A | | **TheOmegaDirective v2.0** | 3644 | IQ4_XS | N/A | N/A | | **MagnumDiamond** | 3575 | Q8_0 | N/A | N/A | | DarkestTiger 9B v1 | 3524 | Q8_0 | N/A | N/A | | **Clara** | 3514 | IQ4_XS | N/A | N/A | | **Pantheon RP 1.8** | 3445 | IQ4_XS | N/A | N/A | | Smilodon 9B v0.5 | 3090 | Q8_0 | Pass | N/A | | **Angel** | 3289 | Q6_K | N/A | N/A | | **Mistral-Small-3.2-24B-Instruct-2506** | 3134 | IQ4_XS | N/A | N/A | | FallenCommand v1c | 3134 | IQ3_S | Pass | N/A | N/A | | Beck 8B | 3100 | Q8_0 | N/A | N/A | | **DansPersonalityEngine v1.3** | 3026 | Q8_0 | N/A | N/A | | FallenCommand v1b | 2915 | IQ3_S | Pass | 0/100 | | Magnum v4 9b abliterated | 2801 | Q8_0 | Pass | 8/100 | **Queue Backlog** | Model | Score | Quant | Q0G | Refusals | | :--- | :--- | :--- | :--- | :--- | | MN-12B-Mag-Mell-R1-Uncensored | N/A | Q6_K | N/A | 0/100 | | Boreas v1.1 | 5696 | Q6_K | Pass| N/A | | Boreas v1.2 | 6999 | Q6_K | Pass | N/A | | Boreas v1.3 | N/A | Q6_K | N/A | N/A | | **WeirdCompound v1.7** | N/A | Q6_K | Fail | 25/100 | | **Circuitry v3** | N/A | Q6_K | Fail | 25/100 | | **Rotor v1** | N/A | Q6_K | Fail | 26/100 | | **Precog v1b** | N/A | Q6_K | Pass | 3/100 | - Fallen Gemma 3 27B - FallenGLM4 v1b - FallenMistralSmall v1f - FallenLlama v3.3 R1 - FallenGPTOss v1b - FallenScout v1a - FallenQwQ v1d - FallenCommand v1c - Orochi v0 cp6 - Golem 70B v1a - Golem 70B v1b 26/100 - PaintedFantasy v3 - DarkOsmosis v1 - Huihui-Qwen3-VL-32B-Thinking-abliterated - Smegma Deluxe - Odins Smegma - Odin - Morbid Miasma - Xortron - Beepo - GPT OSS 20B Heretic - GPT OSS 120B Heretic - Kalypso - Toxic Hermes 2.5 - Cerebras Minimax M2 Reap 139B A10B - Theta Black Gorgon - Quill abliterated - Darkest Muse abliterated - Harbinger abliterated - MistralThinker v1.1 abliterated - Asmodeus 24B - Psychosis 14B v1 - GLM 4.5 Air Derestricted - Jungle Oasis 9B - Frozen Tundra 12B - StationV 24B - SpaceBound 24B - Cydonia v4.3 - Magidonia v4.3 / Heretic - Kraken 12B - Boreas 24B - Goetia v1.2 / Ablated - GLM 4.7 - JustOnion/Mag-Mell-R1-Uncensored-21B - Cthulhu v1.4 **Unversioned Checkpoints** | Model | Score | Quant | Q0G | Refusals | | :--- | :--- | :--- | :--- | :--- | | **Checkpoint A** | 6321 | Q6_K | N/A | N/A | | **Checkpoint B** | 4181 | Q6_K | N/A | N/A | | **Checkpoint D** | 6625 | Q8_0 | N/A | N/A | | **Checkpoint E** | 7523 | Q8_0 | N/A | N/A | | **Checkpoint F** | 8559 | Q8_0 | N/A | N/A | | **Checkpoint G1 (FallenMagidoniaSlerp)** | 5878 | Q6_K | N/A | N/A | | **Checkpoint G2 (FallenDolphinSlerp)** | 5568 | Q6_K | N/A | N/A | | **Checkpoint H2 (ModelStock17M)** | 4359 | Q6_K | N/A | N/A | | **Checkpoint I0 (Karcher3B)** | 5057 | Q6_K | Pass | N/A | | **Checkpoint I1 (Karcher4A)** | 10178 | Q8_K_XL | Pass | N/A | | **Checkpoint I2 (Karcher4B)** | 8929 | Q8_K_XL | Pass | N/A | | **Checkpoint K (Karcher6A)** | 9906 | Q8_K_XL | Pass | N/A | | **Checkpoint L (Karcher4C)** | 10333 | Q8_K_XL | Pass | N/A | | **Checkpoint M (Karcher 6B)** | 9980 | Q8_K_XL | Pass | N/A | | **Checkpoint N (Karcher 6C)** | 10416 | Q8_K_XL | Pass | N/A | | **Checkpoint O (Karcher 5B)** | 9315 | Q8_K_XL | Pass | N/A | | **Checkpoint R2 (Karcher8)** | 8032 | Q6_K | Pass | N/A | | **Checkpoint R3 (Karcher7)** | 7461 | Q6_K | Pass | 20/100 | | **Checkpoint R4 (Karcher6)** | 9566 | Q8_0 | Pass | 20/100 | | **Checkpoint R5 (Karcher7)** | 8404 | Q8_0 | Pass | N/A | | **Checkpoint R6 (Karcher9)** | 9555 | Q8_0 | Pass | N/A | | **Checkpoint R7 (Karcher5)** | 9915 | Q8_0 | Pass | 19/100 | | **Checkpoint R8 (Karcher8)** | 9400 | Q8_0 | Pass | 19/100 | | **Checkpoint R9 (Karcher4)** | 7979 | Q6_K | Pass | 20/100 | | **Checkpoint R10 (Karcher7)** | 9212 | Q8_0 | Pass | 20/100 | | **Checkpoint R11 (Karcher6)** | 10401 | Q8_0 | Pass |20/100 | | **Checkpoint R12 (Karcher8)** | 8410 | Q8_0 | Pass | 18/100 | | **Checkpoint R13 (Karcher5)** | 7724 | Q8_0 | Pass | 9/100 | | **Checkpoint R14 (SLERP-R11-R13)** | 8783 | Q8_0 | Pass | 17/100 | | **Checkpoint R15 (Karcher-R11-R13)** | 8645 | Q8_0 | Pass | 16/100 | | **Checkpoint R16 (Karcher9)** | 8845 | Q8_0 | Pass | 19/100 | | **Checkpoint R17 (Karcher7)** | 8958 | Q8_0 | Pass | 14/100 | | **Checkpoint R18 (Karcher4)** | N/A | Q6_K | Pass | 16/100 | | **Checkpoint R21 (SLERP-R19-R20)** | 7475 | Q8_0 | Pass | 15/100 | | **Checkpoint R22 (NuSLERP-R19-R20-Magidonia)** | 7854 | Q8_0 | Pass | 14/100 | | Psychosis 9B v1q2 | 7032 | Q8_0 | Pass | N/A | | Spacebound RSCE | 3560 | Q6_K | N/A | N/A |