Vortex5 commited on
Commit
87cdff0
·
verified ·
1 Parent(s): 7f75591

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +374 -34
README.md CHANGED
@@ -1,48 +1,388 @@
1
  ---
2
- base_model: []
 
 
 
 
 
 
 
 
3
  library_name: transformers
4
  tags:
5
  - mergekit
6
  - merge
7
-
 
8
  ---
9
- # merge
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the hcr merge method using ./intermediates/First as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * ./intermediates/Second
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- base_model: ./intermediates/First
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  chat_template: auto
 
 
 
 
 
30
  dtype: float32
31
- merge_method: hcr
32
- modules:
33
- default:
34
- slices:
35
- - sources:
36
- - layer_range: [0, 40]
37
- model: ./intermediates/Second
38
- - layer_range: [0, 40]
39
- model: ./intermediates/First
40
  out_dtype: bfloat16
 
 
 
 
 
 
 
 
 
 
41
  parameters:
42
- novelty: 0.36
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
  retention: 0.6
 
44
  stability: 0.7
45
- strength: 0.5
 
46
  tokenizer:
47
  source: Vortex5/Nether-Moon-12B
48
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - Vortex5/Starlit-Shadow-12B
4
+ - Vortex5/Wicked-Nebula-12B
5
+ - Vortex5/Crimson-Constellation-12B
6
+ - Vortex5/Nether-Moon-12B
7
+ - Vortex5/Moonlit-Shadow-12B
8
+ - Vortex5/Amber-Starlight-12B
9
+ - Vortex5/Azure-Starlight-12B
10
+ - Vortex5/Violet-Starlight-12B
11
  library_name: transformers
12
  tags:
13
  - mergekit
14
  - merge
15
+ - roleplay
16
+ license: apache-2.0
17
  ---
18
+ <section class="container">
19
+ <div class="header">
20
+ <h1 class="title-main">Ethereal-Stardust-12B</h1>
21
+ </div>
22
+
23
+ <div class="image-box">
24
+ <img src="cover.png" alt="Ethereal-Stardust-12B">
25
+ </div>
26
+
27
+ <div class="divider"></div>
28
+
29
+ <section class="card">
30
+ <h2 class="card-title">Overview</h2>
31
+ <p>
32
+ <strong class="highlight">Ethereal-Stardust-12B</strong> is a multi-stage merge combining
33
+ <a href="https://huggingface.co/Vortex5/Starlit-Shadow-12B" class="link">Starlit-Shadow-12B</a>,
34
+ <a href="https://huggingface.co/Vortex5/Wicked-Nebula-12B" class="link">Wicked-Nebula-12B</a>,
35
+ <a href="https://huggingface.co/Vortex5/Crimson-Constellation-12B" class="link">Crimson-Constellation-12B</a>,
36
+ <a href="https://huggingface.co/Vortex5/Nether-Moon-12B" class="link">Nether-Moon-12B</a>,
37
+ <a href="https://huggingface.co/Vortex5/Moonlit-Shadow-12B" class="link">Moonlit-Shadow-12B</a>,
38
+ <a href="https://huggingface.co/Vortex5/Amber-Starlight-12B" class="link">Amber-Starlight-12B</a>,
39
+ <a href="https://huggingface.co/Vortex5/Azure-Starlight-12B" class="link">Azure-Starlight-12B</a>,
40
+ and
41
+ <a href="https://huggingface.co/Vortex5/Violet-Starlight-12B" class="link">Violet-Starlight-12B</a>.
42
+ </p>
43
+
44
+ <details class="config">
45
+ <summary>Multi-stage Merge Configuration</summary>
46
+ <pre>
47
+ name: First
48
+ models:
49
+ - model: Vortex5/Starlit-Shadow-12B
50
+ - model: Vortex5/Wicked-Nebula-12B
51
+ - model: Vortex5/Crimson-Constellation-12B
52
+ - model: Vortex5/Nether-Moon-12B
53
+ - model: Vortex5/Moonlit-Shadow-12B
54
+ merge_method: saef
55
  chat_template: auto
56
+ parameters:
57
+ paradox: 0.42
58
+ strength: 0.89
59
+ boost: 0.33
60
+ modes: 2
61
  dtype: float32
 
 
 
 
 
 
 
 
 
62
  out_dtype: bfloat16
63
+ tokenizer:
64
+ source: Vortex5/Nether-Moon-12B
65
+ ---
66
+ name: Second
67
+ models:
68
+ - model: Vortex5/Amber-Starlight-12B
69
+ - model: Vortex5/Azure-Starlight-12B
70
+ - model: Vortex5/Violet-Starlight-12B
71
+ merge_method: saef
72
+ chat_template: auto
73
  parameters:
74
+ paradox: 0.46
75
+ strength: 0.9
76
+ boost: 0.45
77
+ modes: 2
78
+ dtype: float32
79
+ out_dtype: bfloat16
80
+ tokenizer:
81
+ source: Vortex5/Nether-Moon-12B
82
+ ---
83
+ base_model: First
84
+ models:
85
+ - model: Second
86
+ merge_method: hcr
87
+ chat_template: auto
88
+ parameters:
89
+ strength: 0.5
90
  retention: 0.6
91
+ novelty: 0.36
92
  stability: 0.7
93
+ dtype: float32
94
+ out_dtype: bfloat16
95
  tokenizer:
96
  source: Vortex5/Nether-Moon-12B
97
+ </pre>
98
+ </details>
99
+ </section>
100
+
101
+ <section class="card">
102
+ <h2 class="card-title">Intended Use</h2>
103
+ <div class="grid">
104
+ <div class="tile">
105
+ <span class="tile-main">Roleplay</span>
106
+ <span class="tile-sub">Character-driven interaction</span>
107
+ </div>
108
+ <div class="tile">
109
+ <span class="tile-main">Storytelling</span>
110
+ <span class="tile-sub">Long-form narrative</span>
111
+ </div>
112
+ <div class="tile">
113
+ <span class="tile-main">Creative Writing</span>
114
+ <span class="tile-sub">Atmospheric fiction</span>
115
+ </div>
116
+ </div>
117
+ </section>
118
+
119
+ <div class="divider"></div>
120
+ </section>
121
+
122
+ <style>
123
+ .container{
124
+ --bg: #0a001f;
125
+ --panel: #1e0f3a;
126
+ --panel2: #2d1a55;
127
+ --accent-pink: #ff3ba0;
128
+ --accent-cyan: #1e9fd1;
129
+ --accent-violet: #c44eff;
130
+ --accent-fuchsia: #ff4dd4;
131
+ --text: #f8f4ff;
132
+ --text-dim: #d4b8ff;
133
+ --grad: linear-gradient(90deg, var(--accent-pink), var(--accent-cyan), var(--accent-violet));
134
+
135
+ max-width: 1100px;
136
+ margin: 60px auto;
137
+ padding: 56px 52px;
138
+ position: relative;
139
+ overflow: hidden;
140
+ border: 3px solid rgba(255, 59, 160, 0.25);
141
+ border-radius: 4px;
142
+
143
+ background:
144
+ linear-gradient(135deg, #0a001f 0%, #1a0b38 40%, #2d1a55 70%, #0f0033 100%),
145
+ radial-gradient(circle at 15% 20%, rgba(255, 59, 160, 0.18) 0%, transparent 50%),
146
+ radial-gradient(circle at 85% 75%, rgba(30, 159, 209, 0.14) 0%, transparent 50%),
147
+ radial-gradient(circle at 40% 80%, rgba(196, 78, 255, 0.15) 0%, transparent 45%),
148
+ radial-gradient(circle at 70% 15%, rgba(255, 77, 212, 0.13) 0%, transparent 55%),
149
+ repeating-radial-gradient(circle at 25% 30%, rgba(255,255,255,0.9) 1px, transparent 2px),
150
+ repeating-radial-gradient(circle at 75% 70%, rgba(30,159,209,0.75) 1px, transparent 2px),
151
+ repeating-radial-gradient(circle at 45% 15%, rgba(255,59,160,0.85) 1px, transparent 2px);
152
+
153
+ background-size: 200% 200%, 300% 300%, 250% 250%, 280% 280%, 80px 80px, 95px 95px, 110px 110px;
154
+
155
+ color: var(--text);
156
+ font-family: "Cinzel", "Georgia", "Times New Roman", serif;
157
+ display: flex;
158
+ flex-direction: column;
159
+ gap: 42px;
160
+ box-shadow:
161
+ inset 0 0 80px -30px rgba(196, 78, 255, 0.25);
162
+
163
+ animation: nebula-drift 120s linear infinite;
164
+ }
165
+
166
+ @keyframes nebula-drift {
167
+ 0% { background-position: 0% 50%, 100% 50%, 0% 100%, 100% 0%, 0 0, 0 0, 0 0; }
168
+ 100% { background-position: 100% 50%, 0% 50%, 100% 0%, 0% 100%, 0 0, 0 0, 0 0; }
169
+ }
170
+
171
+ .container::before {
172
+ content: "";
173
+ position: absolute;
174
+ inset: 0;
175
+ pointer-events: none;
176
+ background:
177
+ radial-gradient(circle, rgba(255,255,255,0.95) 1px, transparent 0),
178
+ radial-gradient(circle, rgba(30,159,209,0.8) 1.5px, transparent 0),
179
+ radial-gradient(circle, rgba(255,59,160,0.9) 1px, transparent 0);
180
+ background-size: 120px 120px, 180px 180px, 90px 90px;
181
+ animation: stardust-twinkle 4s linear infinite;
182
+ opacity: 0.72;
183
+ z-index: 1;
184
+ mix-blend-mode: screen;
185
+ }
186
+
187
+ @keyframes stardust-twinkle {
188
+ 0%, 100% { opacity: 0.65; }
189
+ 50% { opacity: 0.92; }
190
+ }
191
+
192
+ .header {
193
+ position: relative;
194
+ z-index: 2;
195
+ display: flex;
196
+ justify-content: center;
197
+ align-items: center;
198
+ text-align: center;
199
+ padding: 32px 0 36px;
200
+ border-bottom: 2px solid rgba(255, 77, 212, 0.3);
201
+ background: linear-gradient(90deg,
202
+ rgba(255,59,160,0.08),
203
+ rgba(30,159,209,0.08),
204
+ rgba(196,78,255,0.08));
205
+ }
206
+
207
+ .title-main {
208
+ margin: 0;
209
+ font-size: clamp(1.15rem, 3.1vw, 2.15rem);
210
+ font-weight: 900;
211
+ letter-spacing: 0.09em;
212
+ text-transform: uppercase;
213
+ line-height: 1.05;
214
+ background: linear-gradient(90deg,
215
+ #ff3ba0,
216
+ #1e9fd1,
217
+ #c44eff,
218
+ #ff4dd4);
219
+ -webkit-background-clip: text;
220
+ background-clip: text;
221
+ color: transparent;
222
+ text-shadow:
223
+ 0 0 18px rgba(255, 59, 160, 0.75),
224
+ 0 0 35px rgba(30, 159, 209, 0.55);
225
+ position: relative;
226
+ }
227
+
228
+
229
+ .image-box {
230
+ position: relative;
231
+ z-index: 2;
232
+ display: flex;
233
+ justify-content: center;
234
+ padding: 12px 0 28px;
235
+ }
236
+
237
+ .image-box img {
238
+ width: 100%;
239
+ max-width: 860px;
240
+ border: 4px solid rgba(255, 77, 212, 0.35);
241
+ box-shadow:
242
+ 0 20px 0 rgba(10, 0, 31, 0.9),
243
+ 0 0 50px 15px rgba(255, 59, 160, 0.4),
244
+ 0 0 80px 25px rgba(30, 159, 209, 0.25);
245
+ border-radius: 4px;
246
+ }
247
+
248
+ .divider {
249
+ position: relative;
250
+ z-index: 2;
251
+ height: 3px;
252
+ width: 100%;
253
+ background: var(--grad);
254
+ box-shadow: 0 0 30px 8px rgba(255, 77, 212, 0.4);
255
+ border-radius: 0;
256
+ opacity: 0.9;
257
+ }
258
+
259
+ .card {
260
+ position: relative;
261
+ z-index: 2;
262
+ background: linear-gradient(135deg, rgba(30,15,58,0.96), rgba(45,26,85,0.96));
263
+ padding: 40px 46px;
264
+ border: 3px solid rgba(255, 59, 160, 0.25);
265
+ border-radius: 4px;
266
+ box-shadow:
267
+ 0 15px 0 rgba(10,0,31,0.9);
268
+ }
269
+
270
+ .card-title {
271
+ margin: 0 0 24px;
272
+ font-size: 1.55rem;
273
+ letter-spacing: 0.15em;
274
+ text-transform: uppercase;
275
+ color: #ff4dd4;
276
+ text-shadow: 0 0 15px rgba(255, 77, 212, 0.6);
277
+ }
278
+
279
+ .card p {
280
+ margin: 16px 0 28px;
281
+ line-height: 1.82;
282
+ color: var(--text-dim);
283
+ font-family: "Inter", "Segoe UI", sans-serif;
284
+ font-size: 1.05rem;
285
+ }
286
+
287
+ .highlight {
288
+ color: #ff3ba0;
289
+ font-weight: 800;
290
+ text-shadow: 0 0 12px rgba(255, 59, 160, 0.5);
291
+ }
292
+
293
+ .link {
294
+ color: #1e9fd1;
295
+ text-decoration: none;
296
+ font-weight: 700;
297
+ transition: all 0.3s ease;
298
+ }
299
+
300
+ .link:hover {
301
+ color: #ff4dd4;
302
+ text-shadow: 0 0 12px rgba(255, 77, 212, 0.7);
303
+ text-decoration: underline;
304
+ }
305
+
306
+ .config {
307
+ margin-top: 26px;
308
+ border: 2px solid rgba(255, 77, 212, 0.3);
309
+ background: rgba(15, 5, 35, 0.95);
310
+ border-radius: 4px;
311
+ overflow: hidden;
312
+ box-shadow: 0 0 25px rgba(255, 77, 212, 0.2);
313
+ }
314
+
315
+ .config summary {
316
+ padding: 18px 26px;
317
+ cursor: pointer;
318
+ font-size: 0.95rem;
319
+ text-transform: uppercase;
320
+ letter-spacing: 0.12em;
321
+ font-weight: 900;
322
+ color: #ff4dd4;
323
+ background: linear-gradient(90deg, #2d1a55, #1e0f3a);
324
+ }
325
+
326
+ .config pre {
327
+ margin: 0;
328
+ padding: 28px 30px;
329
+ font-family: ui-monospace, Consolas, monospace;
330
+ font-size: 0.86rem;
331
+ background: #110833;
332
+ color: #e0c8ff;
333
+ line-height: 1.65;
334
+ overflow-x: auto;
335
+ }
336
+
337
+ .grid {
338
+ display: flex;
339
+ gap: 24px;
340
+ flex-wrap: wrap;
341
+ margin-top: 16px;
342
+ }
343
+
344
+ .tile {
345
+ flex: 1 1 200px;
346
+ padding: 28px 24px;
347
+ background: linear-gradient(135deg, rgba(45,26,85,0.9), rgba(30,15,58,0.9));
348
+ border: 2px solid rgba(196,78,255,0.3);
349
+ text-align: center;
350
+ border-radius: 4px;
351
+ transition: all 0.4s cubic-bezier(0.4, 0, 0.2, 1);
352
+ }
353
+
354
+ .tile:hover {
355
+ transform: translateY(-6px) scale(1.04);
356
+ border-color: #ff3ba0;
357
+ box-shadow: 0 0 30px 12px rgba(255, 59, 160, 0.35);
358
+ }
359
+
360
+ .tile-main {
361
+ display: block;
362
+ font-weight: 900;
363
+ text-transform: uppercase;
364
+ letter-spacing: 0.1em;
365
+ color: #1e9fd1;
366
+ margin-bottom: 10px;
367
+ font-size: 1.1rem;
368
+ }
369
+
370
+ .tile-sub {
371
+ font-size: 0.96rem;
372
+ color: var(--text-dim);
373
+ font-family: "Inter", "Segoe UI", sans-serif;
374
+ }
375
+
376
+ @media (max-width: 600px) {
377
+ .container {
378
+ margin: 30px 12px;
379
+ padding: 36px 24px;
380
+ }
381
+ .card {
382
+ padding: 32px 28px;
383
+ }
384
+ .tile {
385
+ flex: 1 1 100%;
386
+ }
387
+ }
388
+ </style>