Vortex5 commited on
Commit
3102d60
·
verified ·
1 Parent(s): ce181b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +262 -25
README.md CHANGED
@@ -1,44 +1,281 @@
1
  ---
2
- base_model: []
 
 
 
 
3
  library_name: transformers
4
  tags:
5
  - mergekit
6
  - merge
7
-
8
  ---
9
- # merge
 
10
 
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
 
12
 
13
- ## Merge Details
14
- ### Merge Method
 
 
15
 
16
- This model was merged using the [Karcher Mean](https://en.wikipedia.org/wiki/Karcher_mean) merge method.
17
 
18
- ### Models Merged
19
 
20
- The following models were included in the merge:
21
- * ./intermediates/First
22
- * ./intermediates/Second
23
 
24
- ### Configuration
 
 
 
 
 
 
 
 
25
 
26
- The following YAML configuration was used to produce this model:
27
 
28
- ```yaml
 
 
 
 
 
 
 
29
  dtype: bfloat16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  merge_method: karcher
31
- modules:
32
- default:
33
- slices:
34
- - sources:
35
- - layer_range: [0, 40]
36
- model: ./intermediates/First
37
- - layer_range: [0, 40]
38
- model: ./intermediates/Second
39
  parameters:
40
- max_iter: 1000.0
41
- tol: 1.0e-09
42
  tokenizer:
43
  source: Vortex5/Crimson-Twilight-12B
44
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - Vortex5/Red-Synthesis-12B
4
+ - Retreatcost/KansenSakura-Erosion-RP-12b
5
+ - Vortex5/NoctyxCosma-12B
6
+ - Vortex5/Crimson-Twilight-12B
7
  library_name: transformers
8
  tags:
9
  - mergekit
10
  - merge
11
+ - roleplay
12
  ---
13
+ <section class="shell cosmic-theme">
14
+
15
 
16
+ <div class="title-frame">
17
+ <div class="title-block wide">
18
+ <h2 class="hero-title">Starlit-Shadow-12B</h2>
19
+ </div>
20
 
21
+ <div class="image-slot inset">
22
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/xkj2QnxaJLjkgl9rKN7Io.png">
23
+ </div>
24
+ </div>
25
 
26
+ <div class="shadow-divider"></div>
27
 
 
28
 
29
+ <section class="pane blended">
30
+ <h2 class="pane-title">Overview<span class="underline"></span></h2>
 
31
 
32
+ <p>
33
+ <strong style="color:#fff">Starry-Shadow-12B</strong> was created through a
34
+ <strong>multi-stage merge</strong> involving
35
+ <a href="https://huggingface.co/Vortex5/Red-Synthesis-12B">Red-Synthesis-12B</a>,
36
+ <a href="https://huggingface.co/Retreatcost/KansenSakura-Erosion-RP-12b">KansenSakura-Erosion-RP-12B</a>,
37
+ <a href="https://huggingface.co/Vortex5/NoctyxCosma-12B">NoctyxCosma-12B</a>,
38
+ and
39
+ <a href="https://huggingface.co/Vortex5/Crimson-Twilight-12B">Crimson-Twilight-12B</a>,
40
+ </p>
41
 
 
42
 
43
+ <details class="expando">
44
+ <summary>Multi-stage merge configuration</summary>
45
+ <pre>
46
+ name: First
47
+ models:
48
+ - model: Vortex5/Red-Synthesis-12B
49
+ merge_method: sm2f
50
+ base_model: Retreatcost/KansenSakura-Erosion-RP-12b
51
  dtype: bfloat16
52
+ tokenizer:
53
+ source: Retreatcost/KansenSakura-Erosion-RP-12b
54
+ ---
55
+ name: Second
56
+ models:
57
+ - model: Vortex5/NoctyxCosma-12B
58
+ merge_method: sm2f
59
+ base_model: Vortex5/Crimson-Twilight-12B
60
+ dtype: bfloat16
61
+ tokenizer:
62
+ source: Vortex5/Crimson-Twilight-12B
63
+ ---
64
+ models:
65
+ - model: First
66
+ - model: Second
67
  merge_method: karcher
68
+ dtype: bfloat16
 
 
 
 
 
 
 
69
  parameters:
70
+ tol: 1e-9
71
+ max_iter: 1000
72
  tokenizer:
73
  source: Vortex5/Crimson-Twilight-12B
74
+ </pre>
75
+ </details>
76
+ </section>
77
+
78
+ <section class="pane blended">
79
+ <h2 class="pane-title">Intended Use<span class="underline"></span></h2>
80
+
81
+ <div class="tag-row">
82
+ <div class="tagbox">🎭 Roleplay</div>
83
+ <div class="tagbox">📜 Storytelling</div>
84
+ <div class="tagbox">🌌 Creative Writing</div>
85
+ </div>
86
+
87
+ </section>
88
+
89
+ <div class="shadow-divider"></div>
90
+
91
+ </section>
92
+
93
+ <style>
94
+
95
+ .shell.cosmic-theme {
96
+ max-width: 1050px;
97
+ margin: 40px auto;
98
+ padding: 42px 26px;
99
+
100
+ background: radial-gradient(
101
+ circle at 50% 60%,
102
+ #0b0b14 0%,
103
+ #07070d 45%,
104
+ #020205 100%
105
+ );
106
+
107
+ border: 3px solid rgba(255, 80, 120, 0.75);
108
+ border-radius: 18px;
109
+
110
+ box-shadow:
111
+ 0 0 60px rgba(0, 0, 0, 0.95),
112
+ inset 0 0 60px rgba(0, 0, 0, 0.75);
113
+
114
+ color: #f2f2f6;
115
+ font-family: "Inter", system-ui, sans-serif;
116
+ }
117
+
118
+ .title-frame {
119
+ text-align: center;
120
+ }
121
+
122
+ .title-block.wide {
123
+ margin: 0 auto 22px;
124
+ padding: 22px 0;
125
+
126
+ background: linear-gradient(
127
+ 135deg,
128
+ rgba(40, 10, 25, 0.95),
129
+ rgba(25, 8, 18, 0.92),
130
+ rgba(15, 5, 12, 0.90)
131
+ );
132
+
133
+ border: 3px solid rgba(255, 80, 120, 0.65);
134
+ border-radius: 14px;
135
+
136
+ box-shadow:
137
+ 0 0 22px rgba(255, 80, 120, 0.35),
138
+ inset 0 0 30px rgba(255, 60, 110, 0.35);
139
+ }
140
+
141
+ .hero-title {
142
+ margin: 0;
143
+ font-family: "Cinzel Decorative", "Cinzel", serif;
144
+ font-size: clamp(3rem, 5vw, 3.8rem);
145
+ font-weight: 700;
146
+ letter-spacing: 0.05em;
147
+
148
+ color: #ff8ccf;
149
+
150
+ text-shadow:
151
+ 0 0 10px rgba(255, 120, 190, 0.55),
152
+ 0 0 24px rgba(255, 80, 140, 0.45);
153
+ }
154
+
155
+ .image-slot img {
156
+ width: 100%;
157
+ max-width: 880px;
158
+
159
+ border: 3px solid rgba(255, 100, 160, 0.85);
160
+ border-radius: 10px;
161
+
162
+ box-shadow:
163
+ 0 0 18px rgba(255, 100, 160, 0.45),
164
+ inset 0 0 10px rgba(255, 80, 120, 0.35);
165
+ }
166
+
167
+ .shadow-divider {
168
+ width: 92%;
169
+ height: 10px;
170
+ margin: 36px auto;
171
+
172
+ background: linear-gradient(
173
+ to right,
174
+ rgba(255, 120, 180, 0.95),
175
+ rgba(90, 30, 60, 0.85),
176
+ rgba(255, 120, 180, 0.95)
177
+ );
178
+
179
+ clip-path: polygon(
180
+ 0% 50%,
181
+ 5% 0%,
182
+ 95% 0%,
183
+ 100% 50%,
184
+ 95% 100%,
185
+ 5% 100%
186
+ );
187
+
188
+ box-shadow:
189
+ 0 0 18px rgba(255, 120, 180, 0.55);
190
+ }
191
+
192
+ .pane {
193
+ margin: 28px 0;
194
+ padding: 28px;
195
+
196
+ border-radius: 8px;
197
+ border: 3px solid rgba(255, 90, 140, 0.7);
198
+
199
+ background: linear-gradient(
200
+ 145deg,
201
+ rgba(30, 8, 20, 0.92),
202
+ rgba(18, 6, 14, 0.88),
203
+ rgba(12, 4, 10, 0.82)
204
+ );
205
+
206
+ box-shadow:
207
+ 0 0 22px rgba(255, 90, 140, 0.25),
208
+ inset 0 0 28px rgba(255, 70, 120, 0.35);
209
+ }
210
+
211
+ .pane-title {
212
+ font-family: "Cinzel Decorative", serif;
213
+ font-size: 2.4rem;
214
+ font-weight: 700;
215
+ letter-spacing: 0.04em;
216
+
217
+ color: #ff9fdc;
218
+
219
+ text-shadow:
220
+ 0 0 12px rgba(255, 140, 200, 0.55),
221
+ 0 0 28px rgba(255, 90, 150, 0.45);
222
+
223
+ padding-bottom: 14px;
224
+ position: relative;
225
+ }
226
+
227
+ .pane-title::after {
228
+ content: "";
229
+ position: absolute;
230
+ left: 0;
231
+ bottom: 0;
232
+ width: 100%;
233
+ height: 3px;
234
+
235
+ background: linear-gradient(
236
+ to right,
237
+ rgba(255, 150, 210, 0.95),
238
+ rgba(0, 0, 0, 0)
239
+ );
240
+ }
241
+
242
+ .tag-row {
243
+ display: flex;
244
+ justify-content: center;
245
+ gap: 14px;
246
+ flex-wrap: wrap;
247
+ margin: 14px 0;
248
+ }
249
+
250
+ .tagbox {
251
+ padding: 10px 18px;
252
+ font-size: 1.15rem;
253
+
254
+ background: rgba(20, 8, 14, 0.85);
255
+ border: 2px solid rgba(255, 120, 180, 0.65);
256
+ border-radius: 10px;
257
+
258
+ box-shadow:
259
+ 0 0 12px rgba(255, 120, 180, 0.35);
260
+ }
261
+
262
+ details.expando {
263
+ margin-top: 16px;
264
+ background: rgba(10, 4, 8, 0.85);
265
+ border: 2px solid rgba(255, 100, 160, 0.45);
266
+ }
267
+
268
+ details summary {
269
+ padding: 12px;
270
+ font-family: "JetBrains Mono", monospace;
271
+ font-size: 0.85rem;
272
+ cursor: pointer;
273
+ }
274
+
275
+ pre {
276
+ background: rgba(6, 2, 4, 0.85);
277
+ color: #ffd6ef;
278
+ padding: 18px;
279
+ overflow-x: auto;
280
+ }
281
+ </style>