Vortex5 commited on
Commit
812368b
·
verified ·
1 Parent(s): 2b82a6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +473 -30
README.md CHANGED
@@ -1,45 +1,488 @@
1
  ---
2
- base_model: []
 
 
 
 
3
  library_name: transformers
4
  tags:
5
  - mergekit
6
  - merge
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
- # merge
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
 
13
- ## Merge Details
14
- ### Merge Method
15
 
16
- This model was merged using the [Karcher Mean](https://en.wikipedia.org/wiki/Karcher_mean) merge method.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
 
18
- ### Models Merged
 
 
 
 
 
 
 
 
 
 
19
 
20
- The following models were included in the merge:
21
- * ./intermediates/Second
22
- * ./intermediates/First
 
 
 
 
 
23
 
24
- ### Configuration
 
 
 
 
 
 
 
 
 
 
25
 
26
- The following YAML configuration was used to produce this model:
 
 
 
 
 
 
27
 
28
- ```yaml
29
- chat_template: auto
30
- dtype: float32
31
- merge_method: karcher
32
- modules:
33
- default:
34
- slices:
35
- - sources:
36
- - layer_range: [0, 40]
37
- model: ./intermediates/First
38
- - layer_range: [0, 40]
39
- model: ./intermediates/Second
40
- out_dtype: bfloat16
41
- parameters:
42
- max_iter: 1000.0
43
- tol: 1.0e-09
44
- tokenizer: {}
45
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - ReadyArt/Omega-Darker_The-Final-Directive-12B
4
+ - crestf411/nemo-sunfall-v0.6.1
5
+ - nbeerbower/Lyra4-Gutenberg-12B
6
+ - Delta-Vector/Rei-V3-KTO-12B
7
  library_name: transformers
8
  tags:
9
  - mergekit
10
  - merge
11
+ - roleplay
12
+ license: apache-2.0
13
+ ---
14
+ <section class="wrapper">
15
+ <div class="top">
16
+ <h1 class="heading">Mythic-Fabulist-12B</h1>
17
+ </div>
18
+
19
+ <div class="media">
20
+ <img src="cover.png">
21
+ </div>
22
+
23
+ <div class="line"></div>
24
+
25
+ <section class="panel">
26
+ <h2 class="panel-heading">Overview</h2>
27
+ <p>
28
+ <strong class="accent">Mythic-Fabulist-12B</strong> is a multi-stage combining
29
+ <a href="https://huggingface.co/ReadyArt/Omega-Darker_The-Final-Directive-12B" class="text-link">Omega-Darker The Final Directive-12B</a>,
30
+ <a href="https://huggingface.co/crestf411/nemo-sunfall-v0.6.1" class="text-link">nemo-sunfall-v0.6.1</a>,
31
+ <a href="https://huggingface.co/nbeerbower/Lyra4-Gutenberg-12B" class="text-link">Lyra4-Gutenberg-12B</a>,
32
+ and
33
+ <a href="https://huggingface.co/Delta-Vector/Rei-V3-KTO-12B" class="text-link">Rei-V3-KTO-12B</a>.
34
+ </p>
35
 
36
+ <details class="toggle">
37
+ <summary>Multi-stage Merge Configuration</summary>
38
+ <pre>
39
+ name: First
40
+ models:
41
+ - model: ReadyArt/Omega-Darker_The-Final-Directive-12B
42
+ merge_method: nearswap
43
+ base_model: crestf411/nemo-sunfall-v0.6.1
44
+ parameters:
45
+ t: 0.0008
46
+ dtype: float32
47
  ---
48
+ name: Second
49
+ models:
50
+ - model: nbeerbower/Lyra4-Gutenberg-12B
51
+ merge_method: nearswap
52
+ base_model: Delta-Vector/Rei-V3-KTO-12B
53
+ parameters:
54
+ t: 0.0008
55
+ dtype: float32
56
+ ---
57
+ models:
58
+ - model: First
59
+ - model: Second
60
+ merge_method: karcher
61
+ chat_template: auto
62
+ dtype: float32
63
+ out_dtype: bfloat16
64
+ parameters:
65
+ tol: 1e-9
66
+ max_iter: 1000
67
+ tokenizer:
68
+ source: union
69
+ </pre>
70
+ </details>
71
+ </section>
72
 
73
+ <section class="panel">
74
+ <h2 class="panel-heading">Intended Use</h2>
75
+ <div class="columns">
76
+ <div class="item">
77
+ <span class="item-title">Roleplay</span>
78
+ <span class="item-note">Character-driven interaction</span>
79
+ </div>
80
+ <div class="item">
81
+ <span class="item-title">Storytelling</span>
82
+ <span class="item-note">Long-form narrative</span>
83
+ </div>
84
+ <div class="item">
85
+ <span class="item-title">Creative Writing</span>
86
+ <span class="item-note">Atmospheric fiction</span>
87
+ </div>
88
+ </div>
89
+ </section>
90
 
91
+ <div class="line"></div>
92
+ </section>
93
 
94
+ <style>
95
+ .wrapper {
96
+ --paper: #f6efd9;
97
+ --paper-light: #fffaf0;
98
+ --paper-deep: #e8dcc2;
99
+ --ink: #172136;
100
+ --ink-soft: #4d5770;
101
+ --night: #1f2d48;
102
+ --forest: #2f5d46;
103
+ --moss: #68845c;
104
+ --oxblood: #843b38;
105
+ --gold: #c59a45;
106
+ --shadow: rgba(23, 33, 54, 0.2);
107
+ --edge: rgba(31, 45, 72, 0.42);
108
+ --rule: linear-gradient(90deg, var(--night), var(--gold), var(--forest));
109
+ --cut: 24px;
110
+ --cut-small: 15px;
111
 
112
+ max-width: 1080px;
113
+ margin: 58px auto;
114
+ padding: 52px;
115
+ position: relative;
116
+ overflow: hidden;
117
+ color: var(--ink);
118
+ font-family: "Merriweather", "Iowan Old Style", "Book Antiqua", Georgia, serif;
119
+ display: flex;
120
+ flex-direction: column;
121
+ gap: 38px;
122
+ border: 2px solid var(--edge);
123
 
124
+ background:
125
+ radial-gradient(circle at 12% 18%, rgba(132, 59, 56, 0.14), transparent 34%),
126
+ radial-gradient(circle at 86% 20%, rgba(47, 93, 70, 0.14), transparent 32%),
127
+ radial-gradient(circle at 78% 88%, rgba(197, 154, 69, 0.18), transparent 38%),
128
+ linear-gradient(135deg, #fff8e8 0%, #f1e6ca 48%, #e7d9bb 100%);
129
+ box-shadow:
130
+ 0 28px 70px var(--shadow),
131
+ inset 0 0 0 1px rgba(255, 250, 240, 0.8);
132
 
133
+ clip-path: polygon(
134
+ var(--cut) 0,
135
+ calc(100% - var(--cut)) 0,
136
+ 100% var(--cut),
137
+ 100% calc(100% - var(--cut)),
138
+ calc(100% - var(--cut)) 100%,
139
+ var(--cut) 100%,
140
+ 0 calc(100% - var(--cut)),
141
+ 0 var(--cut)
142
+ );
143
+ }
144
 
145
+ .wrapper::before {
146
+ content: "";
147
+ position: absolute;
148
+ inset: 16px;
149
+ z-index: 1;
150
+ pointer-events: none;
151
+ border: 1px solid rgba(132, 59, 56, 0.24);
152
 
153
+ clip-path: polygon(
154
+ var(--cut) 0,
155
+ calc(100% - var(--cut)) 0,
156
+ 100% var(--cut),
157
+ 100% calc(100% - var(--cut)),
158
+ calc(100% - var(--cut)) 100%,
159
+ var(--cut) 100%,
160
+ 0 calc(100% - var(--cut)),
161
+ 0 var(--cut)
162
+ );
163
+ }
164
+
165
+ .wrapper::after {
166
+ content: "";
167
+ position: absolute;
168
+ inset: 0;
169
+ z-index: 0;
170
+ pointer-events: none;
171
+ opacity: 0.32;
172
+ background:
173
+ repeating-linear-gradient(
174
+ 0deg,
175
+ rgba(31, 45, 72, 0.035) 0,
176
+ rgba(31, 45, 72, 0.035) 1px,
177
+ transparent 1px,
178
+ transparent 7px
179
+ ),
180
+ repeating-linear-gradient(
181
+ 90deg,
182
+ rgba(132, 59, 56, 0.028) 0,
183
+ rgba(132, 59, 56, 0.028) 1px,
184
+ transparent 1px,
185
+ transparent 9px
186
+ ),
187
+ radial-gradient(circle, rgba(31, 45, 72, 0.18) 1px, transparent 1px);
188
+ background-size: auto, auto, 72px 72px;
189
+ mix-blend-mode: multiply;
190
+ }
191
+
192
+ .top {
193
+ position: relative;
194
+ z-index: 2;
195
+ text-align: center;
196
+ padding: 32px 24px 28px;
197
+ border: 1px solid rgba(31, 45, 72, 0.32);
198
+ background:
199
+ linear-gradient(180deg, rgba(255, 250, 240, 0.94), rgba(232, 220, 194, 0.9)),
200
+ repeating-linear-gradient(
201
+ 90deg,
202
+ rgba(197, 154, 69, 0.09) 0,
203
+ rgba(197, 154, 69, 0.09) 1px,
204
+ transparent 1px,
205
+ transparent 18px
206
+ );
207
+ box-shadow:
208
+ 0 12px 30px rgba(23, 33, 54, 0.12),
209
+ inset 0 0 0 1px rgba(255, 250, 240, 0.72);
210
+
211
+ clip-path: polygon(
212
+ var(--cut) 0,
213
+ calc(100% - var(--cut)) 0,
214
+ 100% var(--cut),
215
+ 100% calc(100% - var(--cut)),
216
+ calc(100% - var(--cut)) 100%,
217
+ var(--cut) 100%,
218
+ 0 calc(100% - var(--cut)),
219
+ 0 var(--cut)
220
+ );
221
+ }
222
+
223
+ .heading {
224
+ margin: 0;
225
+ font-size: clamp(1.2rem, 3vw, 2.05rem);
226
+ line-height: 1.08;
227
+ letter-spacing: 0.08em;
228
+ text-transform: uppercase;
229
+ font-weight: 900;
230
+ color: var(--night);
231
+ text-shadow:
232
+ 0 1px 0 rgba(255, 250, 240, 0.95),
233
+ 0 0 16px rgba(197, 154, 69, 0.22);
234
+ }
235
+
236
+ .media {
237
+ position: relative;
238
+ z-index: 2;
239
+ display: flex;
240
+ justify-content: center;
241
+ padding: 4px 0 12px;
242
+ }
243
+
244
+ .media img {
245
+ width: 100%;
246
+ max-width: 860px;
247
+ display: block;
248
+ border: 2px solid rgba(197, 154, 69, 0.46);
249
+ background: var(--paper-light);
250
+ box-shadow:
251
+ 0 18px 40px rgba(23, 33, 54, 0.18),
252
+ 0 0 0 8px rgba(255, 250, 240, 0.56);
253
+
254
+ clip-path: polygon(
255
+ var(--cut) 0,
256
+ calc(100% - var(--cut)) 0,
257
+ 100% var(--cut),
258
+ 100% calc(100% - var(--cut)),
259
+ calc(100% - var(--cut)) 100%,
260
+ var(--cut) 100%,
261
+ 0 calc(100% - var(--cut)),
262
+ 0 var(--cut)
263
+ );
264
+ }
265
+
266
+ .line {
267
+ position: relative;
268
+ z-index: 2;
269
+ height: 4px;
270
+ width: 100%;
271
+ background: var(--rule);
272
+ box-shadow:
273
+ 0 0 14px rgba(197, 154, 69, 0.22),
274
+ 0 1px 0 rgba(255, 250, 240, 0.9);
275
+
276
+ clip-path: polygon(
277
+ var(--cut-small) 0,
278
+ calc(100% - var(--cut-small)) 0,
279
+ 100% 50%,
280
+ calc(100% - var(--cut-small)) 100%,
281
+ var(--cut-small) 100%,
282
+ 0 50%
283
+ );
284
+ }
285
+
286
+ .panel {
287
+ position: relative;
288
+ z-index: 2;
289
+ padding: 38px 42px;
290
+ border: 1px solid rgba(47, 93, 70, 0.34);
291
+ background:
292
+ radial-gradient(circle at 12% 10%, rgba(197, 154, 69, 0.11), transparent 32%),
293
+ linear-gradient(180deg, rgba(255, 250, 240, 0.96), rgba(239, 229, 205, 0.94));
294
+ box-shadow:
295
+ 0 15px 36px rgba(23, 33, 54, 0.13),
296
+ inset 0 0 0 1px rgba(255, 250, 240, 0.78);
297
+
298
+ clip-path: polygon(
299
+ var(--cut) 0,
300
+ calc(100% - var(--cut)) 0,
301
+ 100% var(--cut),
302
+ 100% calc(100% - var(--cut)),
303
+ calc(100% - var(--cut)) 100%,
304
+ var(--cut) 100%,
305
+ 0 calc(100% - var(--cut)),
306
+ 0 var(--cut)
307
+ );
308
+ }
309
+
310
+ .panel-heading {
311
+ margin: 0 0 22px;
312
+ font-size: 1.35rem;
313
+ letter-spacing: 0.12em;
314
+ text-transform: uppercase;
315
+ color: var(--forest);
316
+ font-weight: 900;
317
+ }
318
+
319
+ .panel p {
320
+ margin: 14px 0 26px;
321
+ color: var(--ink-soft);
322
+ font-family: "Source Serif 4", Georgia, serif;
323
+ font-size: 1.04rem;
324
+ line-height: 1.85;
325
+ }
326
+
327
+ .accent {
328
+ color: var(--oxblood);
329
+ font-weight: 900;
330
+ }
331
+
332
+ .text-link {
333
+ color: var(--night);
334
+ font-weight: 800;
335
+ text-decoration: underline;
336
+ text-decoration-color: rgba(197, 154, 69, 0.8);
337
+ text-decoration-thickness: 1px;
338
+ text-underline-offset: 4px;
339
+ transition:
340
+ color 0.22s ease,
341
+ text-decoration-color 0.22s ease;
342
+ }
343
+
344
+ .text-link:hover {
345
+ color: var(--oxblood);
346
+ text-decoration-color: var(--forest);
347
+ }
348
+
349
+ .toggle {
350
+ margin-top: 28px;
351
+ overflow: hidden;
352
+ border: 1px solid rgba(31, 45, 72, 0.3);
353
+ background: var(--paper-light);
354
+ box-shadow:
355
+ inset 0 0 0 1px rgba(255, 250, 240, 0.72),
356
+ 0 10px 24px rgba(23, 33, 54, 0.1);
357
+
358
+ clip-path: polygon(
359
+ var(--cut-small) 0,
360
+ calc(100% - var(--cut-small)) 0,
361
+ 100% var(--cut-small),
362
+ 100% calc(100% - var(--cut-small)),
363
+ calc(100% - var(--cut-small)) 100%,
364
+ var(--cut-small) 100%,
365
+ 0 calc(100% - var(--cut-small)),
366
+ 0 var(--cut-small)
367
+ );
368
+ }
369
+
370
+ .toggle summary {
371
+ padding: 17px 24px;
372
+ cursor: pointer;
373
+ color: var(--paper-light);
374
+ background:
375
+ linear-gradient(90deg, var(--night), #2c3f62, var(--forest));
376
+ font-size: 0.92rem;
377
+ font-weight: 900;
378
+ letter-spacing: 0.09em;
379
+ text-transform: uppercase;
380
+ }
381
+
382
+ .toggle pre {
383
+ margin: 0;
384
+ padding: 26px 28px;
385
+ overflow-x: auto;
386
+ color: #25304a;
387
+ background:
388
+ repeating-linear-gradient(
389
+ 0deg,
390
+ rgba(31, 45, 72, 0.035) 0,
391
+ rgba(31, 45, 72, 0.035) 1px,
392
+ transparent 1px,
393
+ transparent 8px
394
+ ),
395
+ linear-gradient(180deg, #fffaf0, #eee1c4);
396
+ font-family: "IBM Plex Mono", "SFMono-Regular", Consolas, monospace;
397
+ font-size: 0.84rem;
398
+ line-height: 1.68;
399
+ border-top: 1px solid rgba(31, 45, 72, 0.16);
400
+ }
401
+
402
+ .columns {
403
+ display: flex;
404
+ gap: 22px;
405
+ flex-wrap: wrap;
406
+ margin-top: 16px;
407
+ }
408
+
409
+ .item {
410
+ flex: 1 1 210px;
411
+ padding: 26px 22px;
412
+ text-align: center;
413
+ border: 1px solid rgba(132, 59, 56, 0.28);
414
+ background:
415
+ radial-gradient(circle at 50% 0%, rgba(197, 154, 69, 0.12), transparent 44%),
416
+ linear-gradient(180deg, rgba(255, 250, 240, 0.98), rgba(235, 224, 200, 0.94));
417
+ box-shadow:
418
+ 0 11px 26px rgba(23, 33, 54, 0.1),
419
+ inset 0 0 0 1px rgba(255, 250, 240, 0.72);
420
+ transition:
421
+ transform 0.22s ease,
422
+ border-color 0.22s ease,
423
+ box-shadow 0.22s ease;
424
+
425
+ clip-path: polygon(
426
+ var(--cut-small) 0,
427
+ calc(100% - var(--cut-small)) 0,
428
+ 100% var(--cut-small),
429
+ 100% calc(100% - var(--cut-small)),
430
+ calc(100% - var(--cut-small)) 100%,
431
+ var(--cut-small) 100%,
432
+ 0 calc(100% - var(--cut-small)),
433
+ 0 var(--cut-small)
434
+ );
435
+ }
436
+
437
+ .item:hover {
438
+ transform: translateY(-4px);
439
+ border-color: rgba(197, 154, 69, 0.6);
440
+ box-shadow:
441
+ 0 17px 34px rgba(23, 33, 54, 0.16),
442
+ 0 0 24px rgba(197, 154, 69, 0.13);
443
+ }
444
+
445
+ .item-title {
446
+ display: block;
447
+ margin-bottom: 10px;
448
+ color: var(--oxblood);
449
+ font-size: 1.03rem;
450
+ font-weight: 900;
451
+ letter-spacing: 0.08em;
452
+ text-transform: uppercase;
453
+ }
454
+
455
+ .item-note {
456
+ display: block;
457
+ color: var(--ink-soft);
458
+ font-family: "Source Sans 3", "Segoe UI", sans-serif;
459
+ font-size: 0.96rem;
460
+ line-height: 1.5;
461
+ }
462
+
463
+ @media (max-width: 650px) {
464
+ .wrapper {
465
+ margin: 28px 12px;
466
+ padding: 30px 22px;
467
+ gap: 30px;
468
+ --cut: 16px;
469
+ --cut-small: 12px;
470
+ }
471
+
472
+ .top {
473
+ padding: 28px 16px 24px;
474
+ }
475
+
476
+ .panel {
477
+ padding: 30px 24px;
478
+ }
479
+
480
+ .columns {
481
+ gap: 16px;
482
+ }
483
+
484
+ .item {
485
+ flex: 1 1 100%;
486
+ }
487
+ }
488
+ </style>