Vortex5 commited on
Commit
0b67b8b
·
verified ·
1 Parent(s): 6ef03a0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +386 -34
README.md CHANGED
@@ -1,44 +1,396 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # merge
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
12
 
13
- ## Merge Details
14
- ### Merge Method
 
 
 
 
 
 
15
 
16
- This model was merged using the [Karcher Mean](https://en.wikipedia.org/wiki/Karcher_mean) merge method.
17
 
18
- ### Models Merged
19
 
20
- The following models were included in the merge:
21
- * ./intermediates/First
22
- * ./intermediates/Second
 
 
 
 
 
 
23
 
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  dtype: bfloat16
 
 
 
 
30
  merge_method: karcher
31
- modules:
32
- default:
33
- slices:
34
- - sources:
35
- - layer_range: [0, 40]
36
- model: ./intermediates/First
37
- - layer_range: [0, 40]
38
- model: ./intermediates/Second
39
  parameters:
40
- max_iter: 35000.0
41
- tol: 1.0e-09
42
  tokenizer:
43
  source: Vortex5/Hollow-Aether-12B
44
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Nitral-AI/Captain-Eris_Violet-V0.420-12B
4
+ - Vortex5/Scarlet-Ink-12B
5
+ - Vortex5/Sunlit-Shadow-12B
6
+ - Vortex5/Hollow-Aether-12B
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+ - roleplay
12
+ ---
13
+ <section class="shell hollow-rose-theme">
14
 
15
+ <div class="title-frame">
16
+ <div class="title-block wide">
17
+ <h2 class="hero-title">Hollowed-Rose-12B</h2>
18
+ </div>
19
+ <div class="image-slot inset">
20
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/Zr1Qd8kEinugWX_iGm11B.png">
21
+ </div>
22
+ </div>
23
 
24
+ <div class="theme-divider"></div>
25
 
 
26
 
27
+ <section class="pane velvet">
28
+ <h2 class="pane-title hover-glow">Overview<span class="underline"></span></h2>
29
+ <p>
30
+ <strong>Hollowed-Rose-12B</strong> is a multi-stage merge using the following models:
31
+ <a href="https://huggingface.co/Nitral-AI/Captain-Eris_Violet-V0.420-12B" target="_blank">Captain-Eris_Violet-V0.420-12B</a>,
32
+ <a href="https://huggingface.co/Vortex5/Scarlet-Ink-12B" target="_blank">Scarlet-Ink-12B</a>,
33
+ <a href="https://huggingface.co/Vortex5/Sunlit-Shadow-12B" target="_blank">Sunlit-Shadow-12B</a>, and
34
+ <a href="https://huggingface.co/Vortex5/Hollow-Aether-12B" target="_blank">Vortex5/Hollow-Aether-12B</a>.
35
+ </p>
36
 
37
+ <details class="expando nested" style="margin-top:12px;">
38
+ <summary>Show YAML Config</summary>
39
+ <pre>
40
+ name: First
41
+ models:
42
+ - model: Nitral-AI/Captain-Eris_Violet-V0.420-12B
43
+ merge_method: nearswap
44
+ base_model: Vortex5/Scarlet-Ink-12B
45
+ parameters:
46
+ t: 0.0008
47
+ dtype: bfloat16
48
+ tokenizer:
49
+ source: Vortex5/Scarlet-Ink-12B
50
+ ---
51
+ name: Second
52
+ models:
53
+ - model: Vortex5/Sunlit-Shadow-12B
54
+ merge_method: nearswap
55
+ base_model: Vortex5/Hollow-Aether-12B
56
+ parameters:
57
+ t: 0.0008
58
  dtype: bfloat16
59
+ ---
60
+ models:
61
+ - model: First
62
+ - model: Second
63
  merge_method: karcher
64
+ dtype: bfloat16
 
 
 
 
 
 
 
65
  parameters:
66
+ tol: 1e-9
67
+ max_iter: 35000
68
  tokenizer:
69
  source: Vortex5/Hollow-Aether-12B
70
+ </pre>
71
+ </details>
72
+ </section>
73
+
74
+
75
+ <section class="pane ashen">
76
+ <h2 class="pane-title hover-glow">Intended Use<span class="underline"></span></h2>
77
+ <div class="tagbox-row">
78
+ <div class="tagbox">🌹 Storytelling</div>
79
+ <div class="tagbox">🕯️ Roleplay</div>
80
+ <div class="tagbox">📜 Creative writing</div>
81
+ </div>
82
+ </section>
83
+
84
+
85
+ <section class="pane thorned">
86
+ <h2 class="pane-title hover-glow">Credits<span class="underline"></span></h2>
87
+ <ul class="credits" style="list-style:none; padding-left:0; margin-left:0;">
88
+ <li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static &amp; imatrix quants</li>
89
+ <li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
90
+ <li><strong><span class="credits-core">Original creators and model authors</span></strong></li>
91
+ </ul>
92
+ </section>
93
+
94
+ <div class="theme-divider"></div>
95
+ </section>
96
+
97
+ <style>
98
+
99
+ @import url('https://fonts.googleapis.com/css2?family=UnifrakturCook:wght@700&family=Cormorant+Garamond:wght@400;500;600&family=Cinzel+Decorative:wght@700&display=swap');
100
+
101
+
102
+ .shell.hollow-rose-theme {
103
+ max-width: 1000px;
104
+ margin: 40px auto;
105
+ padding: 40px 24px;
106
+ position: relative;
107
+
108
+
109
+ background-color: #070608;
110
+ background-image:
111
+ radial-gradient(circle at 0% 0%, rgba(68,16,28,0.38) 0%, rgba(7,6,8,0.0) 50%),
112
+ radial-gradient(circle at 100% 100%, rgba(68,16,28,0.45) 0%, rgba(7,6,8,0.0) 55%);
113
+ border: 3px solid #7b7f88;
114
+ border-radius: 16px;
115
+
116
+ box-shadow:
117
+ 0 0 32px 0 rgba(0,0,0,0.9),
118
+ 0 18px 40px rgba(0,0,0,0.85),
119
+ inset 0 0 25px rgba(0,0,0,0.8),
120
+ inset 0 0 18px rgba(180,40,70,0.15);
121
+
122
+ color: #e7e4eb;
123
+ font-family: "Cormorant Garamond", "Times New Roman", serif;
124
+ overflow: visible;
125
+ }
126
+
127
+
128
+ .title-frame {
129
+ text-align: center;
130
+ margin-bottom: 12px;
131
+ }
132
+
133
+ .title-block.wide {
134
+ width: fit-content;
135
+ margin: 0 auto;
136
+ padding: 16px 40px;
137
+ background: #050306;
138
+ border-radius: 10px;
139
+ border: 2px solid #a9acb8;
140
+ box-shadow:
141
+ 0 0 18px rgba(0,0,0,0.9),
142
+ inset 0 0 10px rgba(220,220,230,0.08),
143
+ 0 0 32px rgba(140,20,40,0.45);
144
+ }
145
+
146
+
147
+ .hero-title {
148
+ margin: 0;
149
+ font-weight: 700;
150
+ font-family: "UnifrakturCook", "Cinzel Decorative", serif;
151
+ font-size: clamp(2.4rem, 5.0vw, 3.4rem);
152
+ letter-spacing: 0.08em;
153
+ text-transform: none;
154
+ color: #f0e7f0;
155
+ text-shadow:
156
+ 0 0 5px rgba(0,0,0,0.9),
157
+ 0 0 14px rgba(0,0,0,0.85),
158
+ 0 0 22px rgba(180,60,90,0.65);
159
+ transition:
160
+ text-shadow 0.35s ease,
161
+ color 0.35s ease,
162
+ transform 0.25s ease;
163
+ }
164
+
165
+ .hero-title:hover {
166
+ color: #ffe9f0;
167
+ transform: translateY(-1px);
168
+ text-shadow:
169
+ 0 0 6px rgba(255,240,245,1),
170
+ 0 0 16px rgba(200,70,100,0.9),
171
+ 0 0 28px rgba(140,40,70,0.8);
172
+ }
173
+
174
+
175
+ .image-slot.inset img {
176
+ display: block;
177
+ margin: 24px auto 0 auto;
178
+ max-width: 94%;
179
+ border-radius: 10px;
180
+ border: 3px solid #8a8f9b;
181
+ box-shadow:
182
+ 0 10px 35px rgba(0,0,0,0.85),
183
+ 0 0 40px rgba(120,20,40,0.45),
184
+ inset 0 0 18px rgba(255,235,240,0.08);
185
+ }
186
+
187
+
188
+ .theme-divider {
189
+ width: 92%;
190
+ max-width: 880px;
191
+ height: 14px;
192
+ margin: 32px auto;
193
+ background: linear-gradient(
194
+ 90deg,
195
+ rgba(210,80,100,0.0) 0%,
196
+ rgba(210,80,100,0.8) 17%,
197
+ rgba(230,120,140,0.95) 50%,
198
+ rgba(210,80,100,0.8) 83%,
199
+ rgba(210,80,100,0.0) 100%
200
+ );
201
+ border-radius: 999px;
202
+ box-shadow:
203
+ 0 0 22px rgba(180,60,90,0.75),
204
+ 0 8px 18px rgba(0,0,0,0.8);
205
+ }
206
+
207
+
208
+ .pane {
209
+ display: block;
210
+ margin: 28px auto !important;
211
+ width: 90%;
212
+ max-width: 780px;
213
+ padding: 30px 30px 28px 30px;
214
+ border-radius: 0;
215
+ font-size: 1.12rem;
216
+ line-height: 1.68;
217
+ letter-spacing: 0.015em;
218
+ text-shadow:
219
+ 0 0 2px rgba(0,0,0,0.7),
220
+ 0 0 4px rgba(0,0,0,0.6);
221
+ }
222
+
223
+
224
+ .pane.velvet {
225
+ border: 2px solid #8b4d5c;
226
+ background: linear-gradient(
227
+ 135deg,
228
+ #0b0507 0%,
229
+ #13070b 35%,
230
+ #19090f 70%,
231
+ #210b14 100%
232
+ );
233
+ box-shadow:
234
+ 0 8px 24px rgba(0,0,0,0.9),
235
+ inset 0 0 24px rgba(220,120,140,0.18);
236
+ }
237
+
238
+
239
+ .pane.ashen {
240
+ border: 2px solid #7f838d;
241
+ background: linear-gradient(
242
+ 135deg,
243
+ #090909 0%,
244
+ #101016 40%,
245
+ #15161c 100%
246
+ );
247
+ box-shadow:
248
+ 0 8px 24px rgba(0,0,0,0.85),
249
+ inset 0 0 20px rgba(255,255,255,0.05);
250
+ }
251
+
252
+
253
+ .pane.thorned {
254
+ border: 2px solid #b2465e;
255
+ background: linear-gradient(
256
+ 135deg,
257
+ #0a0406 0%,
258
+ #130308 30%,
259
+ #18040a 55%,
260
+ #22060e 100%
261
+ );
262
+ box-shadow:
263
+ 0 10px 30px rgba(0,0,0,0.95),
264
+ inset 0 0 24px rgba(190,60,90,0.28);
265
+ }
266
+
267
+
268
+ .pane-title {
269
+ font-family: "Cinzel Decorative", serif;
270
+ font-weight: 700;
271
+ font-size: 2.1rem;
272
+ letter-spacing: 0.1em;
273
+ text-transform: uppercase;
274
+ color: #f0edf2;
275
+ padding-bottom: 12px;
276
+ position: relative;
277
+ margin-top: 0;
278
+ margin-bottom: 12px;
279
+ transition: text-shadow 0.35s ease, color 0.35s ease, transform 0.25s ease;
280
+ }
281
+
282
+ .pane-title::before {
283
+ content: "✥";
284
+ margin-right: 10px;
285
+ font-size: 1.3rem;
286
+ color: #f08a9e;
287
+ }
288
+
289
+ .pane-title::after {
290
+ content: "";
291
+ position: absolute;
292
+ left: 0;
293
+ bottom: 0;
294
+ width: 100%;
295
+ height: 2px;
296
+ background: linear-gradient(
297
+ to right,
298
+ rgba(210,120,140,0.0),
299
+ rgba(210,120,140,0.9),
300
+ rgba(240,200,210,0.0)
301
+ );
302
+ }
303
+
304
+ .pane-title:hover {
305
+ color: #ffeef4;
306
+ transform: translateY(-1px);
307
+ text-shadow:
308
+ 0 0 6px rgba(255,235,245,0.9),
309
+ 0 0 14px rgba(190,60,90,0.9);
310
+ }
311
+
312
+
313
+ .shell.hollow-rose-theme p {
314
+ margin-top: 4px;
315
+ margin-bottom: 8px;
316
+ }
317
+
318
+
319
+ .shell.hollow-rose-theme pre {
320
+ background: rgba(4,2,6,0.95);
321
+ color: #f2ecf5;
322
+ border-left: 4px solid rgba(210,90,120,0.9);
323
+ padding: 12px 14px;
324
+ font-family: "JetBrains Mono", "Courier New", monospace;
325
+ font-size: 0.95rem;
326
+ white-space: pre;
327
+ overflow-x: auto;
328
+ box-shadow:
329
+ inset 0 0 18px rgba(0,0,0,0.9),
330
+ 0 0 14px rgba(0,0,0,0.7);
331
+ }
332
+
333
+
334
+ .shell.hollow-rose-theme a {
335
+ color: #f08a9e;
336
+ text-decoration: none;
337
+ border-bottom: 1px dotted rgba(240,138,158,0.6);
338
+ transition: color 0.25s ease, text-shadow 0.25s ease, border-color 0.25s ease;
339
+ }
340
+
341
+ .shell.hollow-rose-theme a:hover {
342
+ color: #ffe3eb;
343
+ text-shadow:
344
+ 0 0 6px rgba(255,220,235,0.95),
345
+ 0 0 14px rgba(210,90,120,0.9);
346
+ border-bottom-color: rgba(255,227,239,0.9);
347
+ }
348
+
349
+ .credits-core {
350
+ color: #f2c3ce;
351
+ }
352
+
353
+
354
+ .tagbox-row {
355
+ display: flex;
356
+ justify-content: center;
357
+ flex-wrap: wrap;
358
+ gap: 8px;
359
+ margin: 10px 0 4px 0;
360
+ }
361
+
362
+ .tagbox {
363
+ padding: 5px 11px;
364
+ font-size: 1.0rem;
365
+ font-family: "Cormorant Garamond","Cinzel",serif;
366
+ background: radial-gradient(circle at 0% 0%, #2a0e16 0%, #13070c 55%);
367
+ border-radius: 999px;
368
+ border: 1px solid #a94c61;
369
+ color: #f4dde4;
370
+ text-shadow: 0 0 4px rgba(0,0,0,0.8);
371
+ box-shadow:
372
+ 0 0 9px rgba(0,0,0,0.8),
373
+ inset 0 0 10px rgba(200,80,110,0.35);
374
+ white-space: nowrap;
375
+ }
376
+
377
+
378
+ @media (max-width: 768px) {
379
+ .shell.hollow-rose-theme {
380
+ padding: 28px 16px;
381
+ }
382
+ .title-block.wide {
383
+ padding: 12px 22px;
384
+ }
385
+ .pane {
386
+ width: 94%;
387
+ padding: 22px 18px 20px 18px;
388
+ }
389
+ .hero-title {
390
+ font-size: clamp(2.2rem, 7vw, 2.9rem);
391
+ }
392
+ .pane-title {
393
+ font-size: 1.8rem;
394
+ }
395
+ }
396
+ </style>