Naphula commited on
Commit
fc65bd1
·
verified ·
1 Parent(s): afb7e72

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +328 -0
README.md ADDED
@@ -0,0 +1,328 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ ---
4
+
5
+ <!DOCTYPE html>
6
+ <style>
7
+ @import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0,700;1,400&family=Uncial+Antiqua&display=swap');
8
+
9
+ body {
10
+ font-family: 'Crimson Text', serif;
11
+ color: #4A3F35; /* Faded Ink Brown */
12
+ line-height: 1.6;
13
+ margin: 0;
14
+ padding: 0;
15
+ background-color: #281E18; /* Dark Wood Desk */
16
+ }
17
+
18
+ b, strong {
19
+ color: #8C1C13; /* Crimson Seal */
20
+ }
21
+
22
+ .grimoire-text {
23
+ font-family: 'Uncial Antiqua', cursive;
24
+ color: #3D352A; /* Dark Ink */
25
+ position: relative;
26
+ z-index: 2;
27
+ margin-left: 0.2em;
28
+ text-shadow: 0 0 10px #A49687;
29
+ }
30
+
31
+ /* Section styling */
32
+ .section-container {
33
+ background-color: rgba(245, 235, 218, 0.05);
34
+ margin-bottom: 30px;
35
+ position: relative;
36
+ overflow: hidden;
37
+ border-bottom: 1px solid rgba(140, 28, 19, 0.3); /* Faded Crimson Border */
38
+ box-shadow: 0 4px 15px rgba(0, 0, 0, 0.2);
39
+ }
40
+
41
+ .section-header {
42
+ display: flex;
43
+ align-items: center;
44
+ background-color: rgba(140, 28, 19, 0.06);
45
+ padding: 10px 20px;
46
+ }
47
+
48
+ .section-indicator {
49
+ width: 8px;
50
+ height: 20px;
51
+ background-color: #8C1C13;
52
+ margin-right: 15px;
53
+ box-shadow: 0 0 8px rgba(140, 28, 19, 0.4);
54
+ }
55
+
56
+ .section-title {
57
+ font-family: 'Uncial Antiqua', cursive;
58
+ color: #4A3F35;
59
+ font-size: 1.4rem;
60
+ margin: 0;
61
+ letter-spacing: 1px;
62
+ font-weight: 400;
63
+ text-transform: capitalize;
64
+ }
65
+
66
+ .section-content {
67
+ padding: 20px;
68
+ font-family: 'Crimson Text', serif;
69
+ color: #4A3F35;
70
+ line-height: 1.7;
71
+ }
72
+
73
+ /* Title styling */
74
+ .title-container {
75
+ background-color: transparent;
76
+ position: relative;
77
+ overflow: hidden;
78
+ margin-bottom: 40px;
79
+ border-left: 3px solid #8C1C13;
80
+ box-shadow: 0 6px 20px rgba(0, 0, 0, 0.2);
81
+ }
82
+
83
+ .title-wrapper {
84
+ position: relative;
85
+ z-index: 2;
86
+ padding: 25px 20px 30px 30px;
87
+ }
88
+
89
+ .title-main {
90
+ color: #3D352A;
91
+ font-size: 1.8rem;
92
+ font-weight: 700;
93
+ margin: 0;
94
+ letter-spacing: 2px;
95
+ display: inline-block;
96
+ position: relative;
97
+ text-transform: uppercase;
98
+ }
99
+
100
+ /* Subheading styling */
101
+ .subheading {
102
+ font-family: 'Uncial Antiqua', cursive;
103
+ color: #7B5E4A; /* Lighter Ink Brown */
104
+ font-size: 1.1rem;
105
+ margin-top: 20px;
106
+ margin-bottom: 15px;
107
+ font-weight: 400;
108
+ border-bottom: 1px dashed rgba(123, 94, 74, 0.4);
109
+ display: inline-block;
110
+ text-transform: uppercase;
111
+ letter-spacing: 1px;
112
+ }
113
+
114
+ /* Links */
115
+ a {
116
+ color: #7B5E4A;
117
+ text-decoration: none;
118
+ font-weight: bold;
119
+ }
120
+
121
+ a:hover {
122
+ text-decoration: underline;
123
+ color: #8C1C13; /* Crimson Seal on hover */
124
+ }
125
+
126
+ /* Container */
127
+ .container {
128
+ max-width: 1200px;
129
+ margin: 20px auto;
130
+ padding: 40px 20px;
131
+ background-color: #F5EBDA; /* Aged Parchment */
132
+ background-image:
133
+ radial-gradient(circle at 10% 10%, rgba(140, 28, 19, 0.04) 0%, transparent 50%),
134
+ radial-gradient(circle at 90% 80%, rgba(61, 53, 42, 0.06) 0%, transparent 50%);
135
+ min-height: calc(100vh - 40px);
136
+ border: 1px solid #C8BBAA; /* Parchment Edge */
137
+ border-radius: 3px;
138
+ box-shadow: 0 8px 32px rgba(0, 0, 0, 0.3);
139
+ }
140
+
141
+ </style>
142
+ <html lang="en">
143
+ <head>
144
+ <meta charset="UTF-8">
145
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
146
+ <title>Q0 Benchmark</title>
147
+ </head>
148
+ <body>
149
+
150
+ <div class="container">
151
+ <div class="title-container">
152
+ <div class="title-wrapper">
153
+ <h1 class="title-main">
154
+ <span class="grimoire-text">🔮 QO Benchmark</span>
155
+ </h1>
156
+ </div>
157
+ </div>
158
+
159
+ <div class="section-container">
160
+ <div class="section-header">
161
+ <div class="section-indicator"></div>
162
+ <h2 class="section-title">Updated: November 30, 2025</h2>
163
+ </div>
164
+ <div class="section-content"><font face="verdana">
165
+ Ranks output complexity, censorship, instruction following, alignment, and output quality.
166
+
167
+ **Bolded models are Mistral 24B.**
168
+ | Model | Score | Quant | Q0G | Refusals |
169
+ | :--- | :--- | :--- | :--- | :--- |
170
+ | GLM 4.6 | 28514 | IQ2_M | Fail | N/A |
171
+ | Ling Flash 2.0 Abliterated | 15628 | Q4_K_M | Fail | 0/100 |
172
+ | DarkForest 20B v2.0 fp32 upscaled | 13106 | Q6_K | Pass | 21/100 |
173
+ | **Cydonia v4s** | 11346 | Q8_0 | Pass | 16/100 |
174
+ | **Checkpoint J (Karcher5A)** | 11320 | Q8_K_XL | Pass | 20/100 |
175
+ | GLM 4.5 Air Abliterated | 10712 | Q3_K_M | Fail | 0/100 |
176
+ | DarkForest 20B v2.0 Erebus Edition | 10696 | Q6_K | Fail | 0/100 |
177
+ | **Cydonia v4r** | 10683 | Q8_0 | Fail | 15/100 |
178
+ | Gemma 3 27B Abliterated | 10564 | Q8_K_XL | Fail | 0/100 |
179
+ | Seed OSS 36B Instruct | 10353 | Q4_K_XL | Fail | 42/100 |
180
+ | Fallen Gemma 3 27B | 9605 | IQ4_XS | Fail | N/A |
181
+ | **Goetia v1.1 (Checkpoint R20 K10)** | 9331 | Q8_0 | Pass | 19/100 |
182
+ | **Dark World v1 (Checkpoint R19 K4)** | 9298 | Q8_0 | Pass | 4/100 |
183
+ | **Goetia v1 (Checkpoint C)** | 8936 | Q8_K_XL | Fail | 24/100 |
184
+ | **Circuitry v2** | 8445 | Q8_0 | Fail | N/A |
185
+ | **BlackDolphin** | 8309 | Q8_0 | Fail | 9/100 |
186
+ | Warlock 7B v2 (v2a) | 8298 | Q8_0 | Pass | 4/100 |
187
+ | **DolphinMistralVeniceEdition** | 7709 | Q8_0 | Fail | 1/100 |
188
+ | **FireDolphin v1** | 7548 | Q8_K_XL | N/A | N/A |
189
+ | **Mullein v2** | 7545 | Q8_0 | Fail | 6/100 |
190
+ | Delirium v1 abliterated | 7534 | Q8_0 | Fail | 12/100 |
191
+ | **BlackSheep** | 7407 | Q8_0 | N/A | 4/100 |
192
+ | **Evilmind v1** | 6890 | Q6_K | Pass | 2/100 |
193
+ | **PaintedFantasy v2** | 6867 | Q8_0 | Fail | 25/100 |
194
+ | Warlock 7B v1 (v0k) | 6664 | Q8_0 | Fail | 8/100 |
195
+ | **Animus v7.1** | 6199 | Q8_0 | N/A | N/A |
196
+ **Broken Tutu Transgression v2.0** | 6127 | Q6_K | Fail | N/A |
197
+ | **Harbinger** | 5805 | IQ4_XS | N/A | N/A |
198
+ | **MS3.2 Austral Winton** | 5736 | IQ4_XS | N/A | N/A |
199
+ | Gemma The Writer 9B abliterated | 5726 | Q6_K | Fail | 18/100 |
200
+ | **Cydonia v4j** | 5664 | Q8_0 | Pass | 22/100 |
201
+ **Dark Osmosis v1.0** | 5647 | Q6_K | Pass | N/A |
202
+ | Smilodon 9B v1.0 | 5643 | Q8_0 | Pass | N/A |
203
+ | **Codex** | 5569 | IQ4_XS | N/A | N/A |
204
+ | **Cthulhu v1.1** | 5437 | IQ4_XS | N/A | N/A |
205
+ | **Orochi v0cp6** | 5362 | IQ4_XS | N/A | N/A |
206
+ | **WeirdCompound v1.6** | 5286 | Q8_0 | Fail | N/A |
207
+ | **Rivermind v1a** | 5232 | Q6_K | Fail | 12/100 |
208
+ | FallenGLM4 v1b | 5204 | Q8_0 | Fail | N/A |
209
+ | **Cthulhu v1.3** | 5152 | IQ4_XS | N/A | N/A | N/A |
210
+ | **TheOmegaDirective v2.1** | 5110 | IQ4_XS | N/A | N/A |
211
+ | Grok 2 |4962 | IQ1_M | Fail | N/A |
212
+ | **FallenMistralSmall v1f** | 4954 | Q6_K | Fail | N/A |
213
+ | **Cthulhu v1.2** | 4913 | IQ4_XS | N/A | N/A |
214
+ | **FallenMistralSmall v1e** | 4902 | Q8_0 | Pass | 0/100 |
215
+ | **Eldrinox v1** | 4874 | IQ4_XS | N/A | N/A |
216
+ | FallenLlama v3.3 R1 | 4789 | IQ4_XS | Fail | N/A |
217
+ | **Loki v1.3** | 4441 | Q8_0 | N/A | N/A |
218
+ | FallenGPTOss v1b | 4177 | Q8_0 | Pass | N/A |
219
+ | **Rei KTO** | 4168 | IQ4_XS | N/A | N/A |
220
+ | **Mawdistic NightLife** | 4167 | Q6_K | N/A | N/A |
221
+ | FallenScout v1a | 4163 | Q4_K_M | Pass | N/A |
222
+ | **Cthulhu v1.0** | 4128 | IQ4_XS | N/A | N/A |
223
+ | EpicurianTiger 9B v1 | 4092 | Q8_0 | N/A | N/A |
224
+ | **Eurydice v3.5** | 4069 | IQ4_XS | N/A | N/A |
225
+ | FallenQwQ v1d | 4065 | Q8_0 | Pass | N/A |
226
+ | Granite 4.0 h tiny abliterated | 3898 | Q6_K | Fail | N/A |
227
+ | Amoral Gemma 3 12B v2 | 3784 | QAT Q4_0 | N/A | N/A |
228
+ | Tiger Gemma 2 9B v3 | 3779 | Q8_0 | Fail | N/A |
229
+ | Granite 3.3 8B | 3736 | Q8_K_XL | Fail | N/A |
230
+ | **Austral Winton** | 3736 | IQ4_XS | N/A | N/A |
231
+ | **MagnumDiamond** | 3575 | Q8_0 | N/A | N/A |
232
+ | DarkestTiger 9B v1 | 3524 | Q8_0 | N/A | N/A |
233
+ | **Clara** | 3514 | IQ4_XS | N/A | N/A |
234
+ | **Pantheon RP 1.8** | 3445 | IQ4_XS | N/A | N/A |
235
+ | Smilodon 9B v0.5 | 3090 | Q8_0 | Pass | N/A |
236
+ | **Angel** | 3289 | Q6_K | N/A | N/A |
237
+ | **Mistral-Small-3.2-24B-Instruct-2506** | 3134 | IQ4_XS | N/A | N/A |
238
+ | FallenCommand v1c | 3134 | IQ3_S | Pass | N/A | N/A |
239
+ | Beck 8B | 3100 | Q8_0 | N/A | N/A |
240
+ | **DansPersonalityEngine v1.3** | 3026 | Q8_0 | N/A | N/A |
241
+ | FallenCommand v1b | 2915 | IQ3_S | Pass | 0/100 |
242
+ | Magnum v4 9b abliterated | 2801 | Q8_0 | Pass | 8/100 |
243
+
244
+ **Queue Backlog**
245
+ | Model | Score | Quant | Q0G | Refusals |
246
+ | :--- | :--- | :--- | :--- | :--- |
247
+ | **WeirdCompound v1.7** | N/A | Q6_K | Fail | 25/100 |
248
+ | **Circuitry v3** | N/A | Q6_K | Fail | 25/100 |
249
+ | **Rotor v1** | N/A | Q6_K | Fail | 26/100 |
250
+ | **Precog v1b** | N/A | Q6_K | Pass | 3/100 |
251
+ - Fallen Gemma 3 27B
252
+ - FallenGLM4 v1b
253
+ - FallenMistralSmall v1f
254
+ - FallenLlama v3.3 R1
255
+ - FallenGPTOss v1b
256
+ - FallenScout v1a
257
+ - FallenQwQ v1d
258
+ - FallenCommand v1c
259
+ - Orochi v0 cp6
260
+ - Golem 70B v1a
261
+ - Golem 70B v1b 26/100
262
+ - PaintedFantasy v3
263
+ - DarkOsmosis v1
264
+ - Huihui-Qwen3-VL-32B-Thinking-abliterated
265
+ - Smegma Deluxe
266
+ - Odins Smegma
267
+ - Odin
268
+ - Morbid Miasma
269
+ - Xortron
270
+ - Beepo
271
+ - GPT OSS 20B Heretic
272
+ - GPT OSS 120B Heretic
273
+ - Kalypso
274
+ - Toxic Hermes 2.5
275
+ - Cerebras Minimax M2 Reap 139B A10B
276
+ - Theta Black Gorgon
277
+ - Quill abliterated
278
+ - Darkest Muse abliterated
279
+ - Harbinger abliterated
280
+ - MistralThinker v1.1 abliterated
281
+ - Asmodeus 24B
282
+ - Psychosis 14B v1
283
+ - GLM 4.5 Air Derestricted
284
+ - Kraken 12B
285
+ - Boreas 24B
286
+ - Goetia v1.2
287
+
288
+ **Unversioned Checkpoints**
289
+ | Model | Score | Quant | Q0G | Refusals |
290
+ | :--- | :--- | :--- | :--- | :--- |
291
+ | **Checkpoint A** | 6321 | Q6_K | N/A | N/A |
292
+ | **Checkpoint B** | 4181 | Q6_K | N/A | N/A |
293
+ | **Checkpoint D** | 6625 | Q8_0 | N/A | N/A |
294
+ | **Checkpoint E** | 7523 | Q8_0 | N/A | N/A |
295
+ | **Checkpoint F** | 8559 | Q8_0 | N/A | N/A |
296
+ | **Checkpoint G1 (FallenMagidoniaSlerp)** | 5878 | Q6_K | N/A | N/A |
297
+ | **Checkpoint G2 (FallenDolphinSlerp)** | 5568 | Q6_K | N/A | N/A |
298
+ | **Checkpoint H2 (ModelStock17M)** | 4359 | Q6_K | N/A | N/A |
299
+ | **Checkpoint I0 (Karcher3B)** | 5057 | Q6_K | Pass | N/A |
300
+ | **Checkpoint I1 (Karcher4A)** | 10178 | Q8_K_XL | Pass | N/A |
301
+ | **Checkpoint I2 (Karcher4B)** | 8929 | Q8_K_XL | Pass | N/A |
302
+ | **Checkpoint K (Karcher6A)** | 9906 | Q8_K_XL | Pass | N/A |
303
+ | **Checkpoint L (Karcher4C)** | 10333 | Q8_K_XL | Pass | N/A |
304
+ | **Checkpoint M (Karcher 6B)** | 9980 | Q8_K_XL | Pass | N/A |
305
+ | **Checkpoint N (Karcher 6C)** | 10416 | Q8_K_XL | Pass | N/A |
306
+ | **Checkpoint O (Karcher 5B)** | 9315 | Q8_K_XL | Pass | N/A |
307
+ | **Checkpoint R2 (Karcher8)** | 8032 | Q6_K | Pass | N/A |
308
+ | **Checkpoint R3 (Karcher7)** | 7461 | Q6_K | Pass | 20/100 |
309
+ | **Checkpoint R4 (Karcher6)** | 9566 | Q8_0 | Pass | 20/100 |
310
+ | **Checkpoint R5 (Karcher7)** | 8404 | Q8_0 | Pass | N/A |
311
+ | **Checkpoint R6 (Karcher9)** | 9555 | Q8_0 | Pass | N/A |
312
+ | **Checkpoint R7 (Karcher5)** | 9915 | Q8_0 | Pass | 19/100 |
313
+ | **Checkpoint R8 (Karcher8)** | 9400 | Q8_0 | Pass | 19/100 |
314
+ | **Checkpoint R9 (Karcher4)** | 7979 | Q6_K | Pass | 20/100 |
315
+ | **Checkpoint R10 (Karcher7)** | 9212 | Q8_0 | Pass | 20/100 |
316
+ | **Checkpoint R11 (Karcher6)** | 10401 | Q8_0 | Pass |20/100 |
317
+ | **Checkpoint R12 (Karcher8)** | 8410 | Q8_0 | Pass | 18/100 |
318
+ | **Checkpoint R13 (Karcher5)** | 7724 | Q8_0 | Pass | 9/100 |
319
+ | **Checkpoint R14 (SLERP-R11-R13)** | 8783 | Q8_0 | Pass | 17/100 |
320
+ | **Checkpoint R15 (Karcher-R11-R13)** | 8645 | Q8_0 | Pass | 16/100 |
321
+ | **Checkpoint R16 (Karcher9)** | 8845 | Q8_0 | Pass | 19/100 |
322
+ | **Checkpoint R17 (Karcher7)** | 8958 | Q8_0 | Pass | 14/100 |
323
+ | **Checkpoint R18 (Karcher4)** | N/A | Q6_K | Pass | 16/100 |
324
+ | **Checkpoint R21 (SLERP-R19-R20)** | 7475 | Q8_0 | Pass | 15/100 |
325
+ | **Checkpoint R22 (NuSLERP-R19-R20-Magidonia)** | 7854 | Q8_0 | Pass | 14/100 |
326
+ | Psychosis 9B v1q2 | 7032 | Q8_0 | Pass | N/A |
327
+
328
+ </font></body></html>