|
|
--- |
|
|
library_name: transformers |
|
|
--- |
|
|
|
|
|
<!DOCTYPE html> |
|
|
<style> |
|
|
@import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0,700;1,400&family=Uncial+Antiqua&display=swap'); |
|
|
|
|
|
body { |
|
|
font-family: 'Crimson Text', serif; |
|
|
color: #4A3F35; /* Faded Ink Brown */ |
|
|
line-height: 1.6; |
|
|
margin: 0; |
|
|
padding: 0; |
|
|
background-color: #281E18; /* Dark Wood Desk */ |
|
|
} |
|
|
|
|
|
b, strong { |
|
|
color: #8C1C13; /* Crimson Seal */ |
|
|
} |
|
|
|
|
|
.grimoire-text { |
|
|
font-family: 'Uncial Antiqua', cursive; |
|
|
color: #3D352A; /* Dark Ink */ |
|
|
position: relative; |
|
|
z-index: 2; |
|
|
margin-left: 0.2em; |
|
|
text-shadow: 0 0 10px #A49687; |
|
|
} |
|
|
|
|
|
/* Section styling */ |
|
|
.section-container { |
|
|
background-color: rgba(245, 235, 218, 0.05); |
|
|
margin-bottom: 30px; |
|
|
position: relative; |
|
|
overflow: hidden; |
|
|
border-bottom: 1px solid rgba(140, 28, 19, 0.3); /* Faded Crimson Border */ |
|
|
box-shadow: 0 4px 15px rgba(0, 0, 0, 0.2); |
|
|
} |
|
|
|
|
|
.section-header { |
|
|
display: flex; |
|
|
align-items: center; |
|
|
background-color: rgba(140, 28, 19, 0.06); |
|
|
padding: 10px 20px; |
|
|
} |
|
|
|
|
|
.section-indicator { |
|
|
width: 8px; |
|
|
height: 20px; |
|
|
background-color: #8C1C13; |
|
|
margin-right: 15px; |
|
|
box-shadow: 0 0 8px rgba(140, 28, 19, 0.4); |
|
|
} |
|
|
|
|
|
.section-title { |
|
|
font-family: 'Uncial Antiqua', cursive; |
|
|
color: #4A3F35; |
|
|
font-size: 1.4rem; |
|
|
margin: 0; |
|
|
letter-spacing: 1px; |
|
|
font-weight: 400; |
|
|
text-transform: capitalize; |
|
|
} |
|
|
|
|
|
.section-content { |
|
|
padding: 20px; |
|
|
font-family: 'Crimson Text', serif; |
|
|
color: #4A3F35; |
|
|
line-height: 1.7; |
|
|
} |
|
|
|
|
|
/* Title styling */ |
|
|
.title-container { |
|
|
background-color: transparent; |
|
|
position: relative; |
|
|
overflow: hidden; |
|
|
margin-bottom: 40px; |
|
|
border-left: 3px solid #8C1C13; |
|
|
box-shadow: 0 6px 20px rgba(0, 0, 0, 0.2); |
|
|
} |
|
|
|
|
|
.title-wrapper { |
|
|
position: relative; |
|
|
z-index: 2; |
|
|
padding: 25px 20px 30px 30px; |
|
|
} |
|
|
|
|
|
.title-main { |
|
|
color: #3D352A; |
|
|
font-size: 1.8rem; |
|
|
font-weight: 700; |
|
|
margin: 0; |
|
|
letter-spacing: 2px; |
|
|
display: inline-block; |
|
|
position: relative; |
|
|
text-transform: uppercase; |
|
|
} |
|
|
|
|
|
/* Subheading styling */ |
|
|
.subheading { |
|
|
font-family: 'Uncial Antiqua', cursive; |
|
|
color: #7B5E4A; /* Lighter Ink Brown */ |
|
|
font-size: 1.1rem; |
|
|
margin-top: 20px; |
|
|
margin-bottom: 15px; |
|
|
font-weight: 400; |
|
|
border-bottom: 1px dashed rgba(123, 94, 74, 0.4); |
|
|
display: inline-block; |
|
|
text-transform: uppercase; |
|
|
letter-spacing: 1px; |
|
|
} |
|
|
|
|
|
/* Links */ |
|
|
a { |
|
|
color: #7B5E4A; |
|
|
text-decoration: none; |
|
|
font-weight: bold; |
|
|
} |
|
|
|
|
|
a:hover { |
|
|
text-decoration: underline; |
|
|
color: #8C1C13; /* Crimson Seal on hover */ |
|
|
} |
|
|
|
|
|
/* Container */ |
|
|
.container { |
|
|
max-width: 1200px; |
|
|
margin: 20px auto; |
|
|
padding: 40px 20px; |
|
|
background-color: #F5EBDA; /* Aged Parchment */ |
|
|
background-image: |
|
|
radial-gradient(circle at 10% 10%, rgba(140, 28, 19, 0.04) 0%, transparent 50%), |
|
|
radial-gradient(circle at 90% 80%, rgba(61, 53, 42, 0.06) 0%, transparent 50%); |
|
|
min-height: calc(100vh - 40px); |
|
|
border: 1px solid #C8BBAA; /* Parchment Edge */ |
|
|
border-radius: 3px; |
|
|
box-shadow: 0 8px 32px rgba(0, 0, 0, 0.3); |
|
|
} |
|
|
|
|
|
</style> |
|
|
<html lang="en"> |
|
|
<head> |
|
|
<meta charset="UTF-8"> |
|
|
<meta name="viewport" content="width=device-width, initial-scale=1.0"> |
|
|
<title>Q0 Benchmark</title> |
|
|
</head> |
|
|
<body> |
|
|
|
|
|
<div class="container"> |
|
|
<div class="title-container"> |
|
|
<div class="title-wrapper"> |
|
|
<h1 class="title-main"> |
|
|
<span class="grimoire-text">🔮 QO Benchmark</span> |
|
|
</h1> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="section-container"> |
|
|
<div class="section-header"> |
|
|
<div class="section-indicator"></div> |
|
|
<h2 class="section-title">Updated: January 8, 2025</h2> |
|
|
</div> |
|
|
<div class="section-content"><font face="verdana"> |
|
|
Ranks output complexity, censorship, instruction following, alignment, and output quality. |
|
|
|
|
|
**Bolded models are Mistral 24B.** |
|
|
| Model | Score | Quant | Q0G | Refusals | |
|
|
| :--- | :--- | :--- | :--- | :--- | |
|
|
| GLM 4.6 | 28514 | IQ2_M | Fail | N/A | |
|
|
| Ling Flash 2.0 Abliterated | 15628 | Q4_K_M | Fail | 0/100 | |
|
|
| DarkForest 20B v2.0 fp32 upscaled | 13106 | Q6_K | Pass | 21/100 | |
|
|
| **Cydonia v4s** | 11346 | Q8_0 | Pass | 16/100 | |
|
|
| **Checkpoint J (Karcher5A)** | 11320 | Q8_K_XL | Pass | 20/100 | |
|
|
| GLM 4.5 Air Abliterated | 10712 | Q3_K_M | Fail | 0/100 | |
|
|
| DarkForest 20B v2.0 Erebus Edition | 10696 | Q6_K | Fail | 0/100 | |
|
|
| **Cydonia v4r** | 10683 | Q8_0 | Fail | 15/100 | |
|
|
| Gemma 3 27B Abliterated | 10564 | Q8_K_XL | Fail | 0/100 | |
|
|
| Seed OSS 36B Instruct | 10353 | Q4_K_XL | Fail | 42/100 | |
|
|
| Fallen Gemma 3 27B | 9605 | IQ4_XS | Fail | N/A | |
|
|
| **Cydonia v4zg Heretic** | 9355 | Q6_K | N/A | N/A | |
|
|
| **Goetia v1.1 (Checkpoint R20 K10)** | 9331 | Q8_0 | Pass | 19/100 | |
|
|
| **Dark World v1 (Checkpoint R19 K4)** | 9298 | Q8_0 | Pass | 4/100 | |
|
|
| **Goetia v1 (Checkpoint C)** | 8936 | Q8_K_XL | Fail | 24/100 | |
|
|
| **Circuitry v2** | 8445 | Q8_0 | Fail | N/A | |
|
|
| **BlackDolphin** | 8309 | Q8_0 | Fail | 9/100 | |
|
|
| Warlock 7B v2 (v2a) | 8298 | Q8_0 | Pass | 4/100 | |
|
|
| **DolphinMistralVeniceEdition** | 7709 | Q8_0 | Fail | 1/100 | |
|
|
| **Morax v1** | 7656 | Q6_K | Pass | N/A | |
|
|
| **FireDolphin v1** | 7548 | Q8_K_XL | N/A | N/A | |
|
|
| **Mullein v2** | 7545 | Q8_0 | Fail | 6/100 | |
|
|
| Delirium v1 abliterated | 7534 | Q8_0 | Fail | 12/100 | |
|
|
| **BlackSheep** | 7407 | Q8_0 | N/A | 4/100 | |
|
|
| **Evilmind v1** | 6890 | Q6_K | Pass | 2/100 | |
|
|
| **PaintedFantasy v2** | 6867 | Q8_0 | Fail | 25/100 | |
|
|
| Warlock 7B v1 (v0k) | 6664 | Q8_0 | Fail | 8/100 | |
|
|
| **Animus v7.1** | 6199 | Q8_0 | N/A | N/A | |
|
|
**Broken Tutu Transgression v2.0** | 6127 | Q6_K | Fail | N/A | |
|
|
| **Harbinger** | 5805 | IQ4_XS | N/A | N/A | |
|
|
| **MS3.2 Austral Winton** | 5736 | IQ4_XS | N/A | N/A | |
|
|
| Gemma The Writer 9B abliterated | 5726 | Q6_K | Fail | 18/100 | |
|
|
| **Cydonia v4j** | 5664 | Q8_0 | Pass | 22/100 | |
|
|
**Dark Osmosis v1.0** | 5647 | Q6_K | Pass | N/A | |
|
|
| Smilodon 9B v1.0 | 5643 | Q8_0 | Pass | N/A | |
|
|
| **Codex** | 5569 | IQ4_XS | N/A | N/A | |
|
|
| **Cthulhu v1.1** | 5437 | IQ4_XS | N/A | N/A | |
|
|
| **Orochi v0cp6** | 5362 | IQ4_XS | N/A | N/A | |
|
|
| **WeirdCompound v1.6** | 5286 | Q8_0 | Fail | N/A | |
|
|
| **Rivermind v1a** | 5232 | Q6_K | Fail | 12/100 | |
|
|
| FallenGLM4 v1b | 5204 | Q8_0 | Fail | N/A | |
|
|
| **Cthulhu v1.3** | 5152 | IQ4_XS | N/A | N/A | N/A | |
|
|
| **TheOmegaDirective v2.1** | 5110 | IQ4_XS | N/A | N/A | |
|
|
| Spacebound Stock | 5056 | Q6_K | N/A | N/A | |
|
|
| Grok 2 |4962 | IQ1_M | Fail | N/A | |
|
|
| **FallenMistralSmall v1f** | 4954 | Q6_K | Fail | N/A | |
|
|
| **Cthulhu v1.2** | 4913 | IQ4_XS | N/A | N/A | |
|
|
| **FallenMistralSmall v1e** | 4902 | Q8_0 | Pass | 0/100 | |
|
|
| **Eldrinox v1** | 4874 | IQ4_XS | N/A | N/A | |
|
|
| FallenLlama v3.3 R1 | 4789 | IQ4_XS | Fail | N/A | |
|
|
| **Loki v1.3** | 4441 | Q8_0 | N/A | N/A | |
|
|
| FallenGPTOss v1b | 4177 | Q8_0 | Pass | N/A | |
|
|
| **Rei KTO** | 4168 | IQ4_XS | N/A | N/A | |
|
|
| **Mawdistic NightLife** | 4167 | Q6_K | N/A | N/A | |
|
|
| FallenScout v1a | 4163 | Q4_K_M | Pass | N/A | |
|
|
| **Cthulhu v1.0** | 4128 | IQ4_XS | N/A | N/A | |
|
|
| EpicurianTiger 9B v1 | 4092 | Q8_0 | N/A | N/A | |
|
|
| **Eurydice v3.5** | 4069 | IQ4_XS | N/A | N/A | |
|
|
| FallenQwQ v1d | 4065 | Q8_0 | Pass | N/A | |
|
|
| Granite 4.0 h tiny abliterated | 3898 | Q6_K | Fail | N/A | |
|
|
| Amoral Gemma 3 12B v2 | 3784 | QAT Q4_0 | N/A | N/A | |
|
|
| Tiger Gemma 2 9B v3 | 3779 | Q8_0 | Fail | N/A | |
|
|
| Granite 3.3 8B | 3736 | Q8_K_XL | Fail | N/A | |
|
|
| **Austral Winton** | 3736 | IQ4_XS | N/A | N/A | |
|
|
| **TheOmegaDirective v2.0** | 3644 | IQ4_XS | N/A | N/A | |
|
|
| **MagnumDiamond** | 3575 | Q8_0 | N/A | N/A | |
|
|
| DarkestTiger 9B v1 | 3524 | Q8_0 | N/A | N/A | |
|
|
| **Clara** | 3514 | IQ4_XS | N/A | N/A | |
|
|
| **Pantheon RP 1.8** | 3445 | IQ4_XS | N/A | N/A | |
|
|
| Smilodon 9B v0.5 | 3090 | Q8_0 | Pass | N/A | |
|
|
| **Angel** | 3289 | Q6_K | N/A | N/A | |
|
|
| **Mistral-Small-3.2-24B-Instruct-2506** | 3134 | IQ4_XS | N/A | N/A | |
|
|
| FallenCommand v1c | 3134 | IQ3_S | Pass | N/A | N/A | |
|
|
| Beck 8B | 3100 | Q8_0 | N/A | N/A | |
|
|
| **DansPersonalityEngine v1.3** | 3026 | Q8_0 | N/A | N/A | |
|
|
| FallenCommand v1b | 2915 | IQ3_S | Pass | 0/100 | |
|
|
| Magnum v4 9b abliterated | 2801 | Q8_0 | Pass | 8/100 | |
|
|
|
|
|
**Queue Backlog** |
|
|
| Model | Score | Quant | Q0G | Refusals | |
|
|
| :--- | :--- | :--- | :--- | :--- | |
|
|
| MN-12B-Mag-Mell-R1-Uncensored | N/A | Q6_K | N/A | 0/100 | |
|
|
| Boreas v1.1 | 5696 | Q6_K | Pass| N/A | |
|
|
| Boreas v1.2 | 6999 | Q6_K | Pass | N/A | |
|
|
| Boreas v1.3 | N/A | Q6_K | N/A | N/A | |
|
|
| **WeirdCompound v1.7** | N/A | Q6_K | Fail | 25/100 | |
|
|
| **Circuitry v3** | N/A | Q6_K | Fail | 25/100 | |
|
|
| **Rotor v1** | N/A | Q6_K | Fail | 26/100 | |
|
|
| **Precog v1b** | N/A | Q6_K | Pass | 3/100 | |
|
|
- Fallen Gemma 3 27B |
|
|
- FallenGLM4 v1b |
|
|
- FallenMistralSmall v1f |
|
|
- FallenLlama v3.3 R1 |
|
|
- FallenGPTOss v1b |
|
|
- FallenScout v1a |
|
|
- FallenQwQ v1d |
|
|
- FallenCommand v1c |
|
|
- Orochi v0 cp6 |
|
|
- Golem 70B v1a |
|
|
- Golem 70B v1b 26/100 |
|
|
- PaintedFantasy v3 |
|
|
- DarkOsmosis v1 |
|
|
- Huihui-Qwen3-VL-32B-Thinking-abliterated |
|
|
- Smegma Deluxe |
|
|
- Odins Smegma |
|
|
- Odin |
|
|
- Morbid Miasma |
|
|
- Xortron |
|
|
- Beepo |
|
|
- GPT OSS 20B Heretic |
|
|
- GPT OSS 120B Heretic |
|
|
- Kalypso |
|
|
- Toxic Hermes 2.5 |
|
|
- Cerebras Minimax M2 Reap 139B A10B |
|
|
- Theta Black Gorgon |
|
|
- Quill abliterated |
|
|
- Darkest Muse abliterated |
|
|
- Harbinger abliterated |
|
|
- MistralThinker v1.1 abliterated |
|
|
- Asmodeus 24B |
|
|
- Psychosis 14B v1 |
|
|
- GLM 4.5 Air Derestricted |
|
|
- Jungle Oasis 9B |
|
|
- Frozen Tundra 12B |
|
|
- StationV 24B |
|
|
- SpaceBound 24B |
|
|
- Cydonia v4.3 |
|
|
- Magidonia v4.3 / Heretic |
|
|
- Kraken 12B |
|
|
- Boreas 24B |
|
|
- Goetia v1.2 / Ablated |
|
|
- GLM 4.7 |
|
|
- JustOnion/Mag-Mell-R1-Uncensored-21B |
|
|
- Cthulhu v1.4 |
|
|
|
|
|
**Unversioned Checkpoints** |
|
|
| Model | Score | Quant | Q0G | Refusals | |
|
|
| :--- | :--- | :--- | :--- | :--- | |
|
|
| **Checkpoint A** | 6321 | Q6_K | N/A | N/A | |
|
|
| **Checkpoint B** | 4181 | Q6_K | N/A | N/A | |
|
|
| **Checkpoint D** | 6625 | Q8_0 | N/A | N/A | |
|
|
| **Checkpoint E** | 7523 | Q8_0 | N/A | N/A | |
|
|
| **Checkpoint F** | 8559 | Q8_0 | N/A | N/A | |
|
|
| **Checkpoint G1 (FallenMagidoniaSlerp)** | 5878 | Q6_K | N/A | N/A | |
|
|
| **Checkpoint G2 (FallenDolphinSlerp)** | 5568 | Q6_K | N/A | N/A | |
|
|
| **Checkpoint H2 (ModelStock17M)** | 4359 | Q6_K | N/A | N/A | |
|
|
| **Checkpoint I0 (Karcher3B)** | 5057 | Q6_K | Pass | N/A | |
|
|
| **Checkpoint I1 (Karcher4A)** | 10178 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint I2 (Karcher4B)** | 8929 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint K (Karcher6A)** | 9906 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint L (Karcher4C)** | 10333 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint M (Karcher 6B)** | 9980 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint N (Karcher 6C)** | 10416 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint O (Karcher 5B)** | 9315 | Q8_K_XL | Pass | N/A | |
|
|
| **Checkpoint R2 (Karcher8)** | 8032 | Q6_K | Pass | N/A | |
|
|
| **Checkpoint R3 (Karcher7)** | 7461 | Q6_K | Pass | 20/100 | |
|
|
| **Checkpoint R4 (Karcher6)** | 9566 | Q8_0 | Pass | 20/100 | |
|
|
| **Checkpoint R5 (Karcher7)** | 8404 | Q8_0 | Pass | N/A | |
|
|
| **Checkpoint R6 (Karcher9)** | 9555 | Q8_0 | Pass | N/A | |
|
|
| **Checkpoint R7 (Karcher5)** | 9915 | Q8_0 | Pass | 19/100 | |
|
|
| **Checkpoint R8 (Karcher8)** | 9400 | Q8_0 | Pass | 19/100 | |
|
|
| **Checkpoint R9 (Karcher4)** | 7979 | Q6_K | Pass | 20/100 | |
|
|
| **Checkpoint R10 (Karcher7)** | 9212 | Q8_0 | Pass | 20/100 | |
|
|
| **Checkpoint R11 (Karcher6)** | 10401 | Q8_0 | Pass |20/100 | |
|
|
| **Checkpoint R12 (Karcher8)** | 8410 | Q8_0 | Pass | 18/100 | |
|
|
| **Checkpoint R13 (Karcher5)** | 7724 | Q8_0 | Pass | 9/100 | |
|
|
| **Checkpoint R14 (SLERP-R11-R13)** | 8783 | Q8_0 | Pass | 17/100 | |
|
|
| **Checkpoint R15 (Karcher-R11-R13)** | 8645 | Q8_0 | Pass | 16/100 | |
|
|
| **Checkpoint R16 (Karcher9)** | 8845 | Q8_0 | Pass | 19/100 | |
|
|
| **Checkpoint R17 (Karcher7)** | 8958 | Q8_0 | Pass | 14/100 | |
|
|
| **Checkpoint R18 (Karcher4)** | N/A | Q6_K | Pass | 16/100 | |
|
|
| **Checkpoint R21 (SLERP-R19-R20)** | 7475 | Q8_0 | Pass | 15/100 | |
|
|
| **Checkpoint R22 (NuSLERP-R19-R20-Magidonia)** | 7854 | Q8_0 | Pass | 14/100 | |
|
|
| Psychosis 9B v1q2 | 7032 | Q8_0 | Pass | N/A | |
|
|
| Spacebound RSCE | 3560 | Q6_K | N/A | N/A | |
|
|
|
|
|
</font></body></html> |
