Vortex5 commited on
Commit
bafc453
·
verified ·
1 Parent(s): eb42b58

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +266 -26
README.md CHANGED
@@ -1,46 +1,286 @@
1
  ---
2
- base_model: []
3
  library_name: transformers
4
  tags:
5
  - mergekit
6
  - merge
7
-
 
8
  ---
9
- # merge
10
 
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
12
 
13
- ## Merge Details
14
- ### Merge Method
 
15
 
16
- This model was merged using the [Karcher Mean](https://en.wikipedia.org/wiki/Karcher_mean) merge method.
17
 
18
- ### Models Merged
19
 
20
- The following models were included in the merge:
21
- * ./intermediates/First
22
- * ./intermediates/Second
23
 
24
- ### Configuration
25
 
26
- The following YAML configuration was used to produce this model:
 
 
 
 
 
 
 
 
27
 
28
- ```yaml
29
- chat_template: auto
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  dtype: float32
 
 
 
 
31
  merge_method: karcher
32
- modules:
33
- default:
34
- slices:
35
- - sources:
36
- - layer_range: [0, 40]
37
- model: ./intermediates/First
38
- - layer_range: [0, 40]
39
- model: ./intermediates/Second
40
  out_dtype: bfloat16
41
  parameters:
42
- max_iter: 1000.0
43
- tol: 1.0e-09
44
  tokenizer:
45
  source: Vortex5/Shining-Seraph-12B
46
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  library_name: transformers
3
  tags:
4
  - mergekit
5
  - merge
6
+ - roleplay
7
+ license: apache-2.0
8
  ---
9
+ <section class="container">
10
 
11
+ <div class="header">
12
+ <h1 class="title-main">Crimson-Constellation-12B</h1>
13
+ </div>
14
 
15
+ <div class="image-box">
16
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/eTZdZapylJqlAALwrRYbl.png">
17
+ </div>
18
 
19
+ <div class="divider"></div>
20
 
 
21
 
22
+ <section class="card">
 
 
23
 
24
+ <h2 class="card-title">Overview</h2>
25
 
26
+ <p>
27
+ <strong class="highlight">Crimson-Constellation-12B</strong> was created through a
28
+ multi-stage merge combining
29
+ <a href="https://huggingface.co/Vortex5/Maroon-Sunset-12B" class="link">Maroon-Sunset-12B</a>,
30
+ <a href="https://huggingface.co/Vortex5/Scarlet-Seraph-12B" class="link">Scarlet-Seraph-12B</a>,
31
+ <a href="https://huggingface.co/Vortex5/Amber-Starlight-12B" class="link">Amber-Starlight-12B</a>,
32
+ and
33
+ <a href="https://huggingface.co/Vortex5/Shining-Seraph-12B" class="link">Shining-Seraph-12B</a>.
34
+ </p>
35
 
36
+
37
+ <details class="config">
38
+ <summary>Multi-stage merge configuration</summary>
39
+ <pre>
40
+ name: First
41
+ models:
42
+ - model: Vortex5/Maroon-Sunset-12B
43
+ merge_method: nearswap
44
+ base_model: Vortex5/Scarlet-Seraph-12B
45
+ parameters:
46
+ t: 0.0008
47
+ dtype: float32
48
+ ---
49
+ name: Second
50
+ models:
51
+ - model: Vortex5/Amber-Starlight-12B
52
+ merge_method: nearswap
53
+ base_model: Vortex5/Shining-Seraph-12B
54
+ parameters:
55
+ t: 0.0008
56
  dtype: float32
57
+ ---
58
+ models:
59
+ - model: First
60
+ - model: Second
61
  merge_method: karcher
62
+ chat_template: auto
63
+ dtype: float32
 
 
 
 
 
 
64
  out_dtype: bfloat16
65
  parameters:
66
+ tol: 1e-9
67
+ max_iter: 1000
68
  tokenizer:
69
  source: Vortex5/Shining-Seraph-12B
70
+ </pre>
71
+ </details>
72
+ </section>
73
+
74
+
75
+ <section class="card">
76
+ <h2 class="card-title">Intended Use</h2>
77
+
78
+ <div class="grid">
79
+ <div class="tile">
80
+ <span class="tile-main">Storytelling</span>
81
+ <span class="tile-sub">Structured long-form narrative</span>
82
+ </div>
83
+
84
+ <div class="tile">
85
+ <span class="tile-main">Roleplay</span>
86
+ <span class="tile-sub">Emotion-forward interaction</span>
87
+ </div>
88
+
89
+ <div class="tile">
90
+ <span class="tile-main">Creative Writing</span>
91
+ <span class="tile-sub">Atmospheric fiction</span>
92
+ </div>
93
+ </div>
94
+ </section>
95
+
96
+ <div class="divider"></div>
97
+
98
+ </section>
99
+
100
+
101
+ <style>
102
+
103
+ .container{
104
+ --bg:#0b0a12;
105
+ --panel:#14121b;
106
+ --glass:rgba(255,255,255,0.04);
107
+
108
+ --text:#f3efff;
109
+ --text-soft:rgba(243,239,255,0.65);
110
+
111
+ --accent:#ff2d55;
112
+ --accent2:#ff7a9b;
113
+
114
+ --grad:linear-gradient(90deg,#ff2d55,#ff7a9b,#ffc97a);
115
+
116
+ max-width:1100px;
117
+ margin:50px auto;
118
+ padding:48px 50px;
119
+ border-radius:22px;
120
+
121
+ background:
122
+ radial-gradient(circle at 20% 10%, rgba(255,45,85,0.15), transparent 40%),
123
+ radial-gradient(circle at 80% 90%, rgba(255,122,155,0.12), transparent 50%),
124
+ var(--bg);
125
+
126
+ color:var(--text);
127
+ font-family:"Inter","Segoe UI",sans-serif;
128
+
129
+ display:flex;
130
+ flex-direction:column;
131
+ gap:40px;
132
+ }
133
+
134
+ .header{
135
+ text-align:center;
136
+ border-bottom:1px solid rgba(255,255,255,0.08);
137
+ padding-bottom:16px;
138
+ }
139
+
140
+ .title-main{
141
+ margin:0;
142
+ font-size:clamp(1.5rem,4vw,2.6rem);
143
+ line-height:1.2;
144
+ font-weight:700;
145
+ letter-spacing:.05em;
146
+
147
+ background:var(--grad);
148
+ -webkit-background-clip:text;
149
+ background-clip:text;
150
+ color:transparent;
151
+ }
152
+
153
+ .image-box{
154
+ display:flex;
155
+ justify-content:center;
156
+ }
157
+
158
+ .image-box img{
159
+ width:100%;
160
+ max-width:900px;
161
+ border-radius:16px;
162
+ border:1px solid rgba(255,255,255,0.08);
163
+ background:var(--glass);
164
+ box-shadow:0 25px 50px rgba(0,0,0,0.5);
165
+ }
166
+
167
+ .divider{
168
+ height:2px;
169
+ width:100%;
170
+ background:var(--grad);
171
+ opacity:.6;
172
+ }
173
+
174
+ .card{
175
+ background:var(--panel);
176
+ padding:28px 30px;
177
+ border-radius:18px;
178
+ border:1px solid rgba(255,255,255,0.06);
179
+ box-shadow:0 12px 30px rgba(0,0,0,0.35);
180
+ }
181
+
182
+ .card-title{
183
+ margin:0 0 14px;
184
+ font-size:1.3rem;
185
+ text-transform:uppercase;
186
+ letter-spacing:.08em;
187
+
188
+ background:var(--grad);
189
+ -webkit-background-clip:text;
190
+ background-clip:text;
191
+ color:transparent;
192
+ }
193
+
194
+ .card p{
195
+ margin:10px 0;
196
+ line-height:1.7;
197
+ }
198
+
199
+ .highlight{
200
+ color:var(--accent);
201
+ font-weight:700;
202
+ }
203
+
204
+ .link{
205
+ color:var(--accent2);
206
+ text-decoration:none;
207
+ }
208
+
209
+ .link:hover{
210
+ text-decoration:underline;
211
+ }
212
+
213
+ .method{
214
+ color:#ffc97a;
215
+ font-weight:600;
216
+ }
217
+
218
+ .config{
219
+ margin-top:18px;
220
+ border:1px solid rgba(255,255,255,0.08);
221
+ border-radius:12px;
222
+ overflow:hidden;
223
+ background:rgba(255,255,255,0.03);
224
+ }
225
+
226
+ .config summary{
227
+ padding:10px 14px;
228
+ cursor:pointer;
229
+ font-size:.85rem;
230
+ font-weight:600;
231
+ letter-spacing:.08em;
232
+ text-transform:uppercase;
233
+ background:rgba(255,255,255,0.05);
234
+ color:var(--accent);
235
+ }
236
+
237
+ .config pre{
238
+ margin:0;
239
+ padding:16px;
240
+ font-family:ui-monospace,Consolas,monospace;
241
+ font-size:.85rem;
242
+ overflow-x:auto;
243
+ background:rgba(0,0,0,0.35);
244
+ color:var(--text);
245
+ }
246
+
247
+ .grid{
248
+ display:flex;
249
+ gap:18px;
250
+ flex-wrap:wrap;
251
+ margin-top:16px;
252
+ }
253
+
254
+ .tile{
255
+ flex:1 1 180px;
256
+ padding:18px;
257
+ border-radius:14px;
258
+ background:rgba(255,255,255,0.05);
259
+ border:1px solid rgba(255,255,255,0.06);
260
+ text-align:center;
261
+ }
262
+
263
+ .tile-main{
264
+ display:block;
265
+ font-weight:700;
266
+ letter-spacing:.08em;
267
+ text-transform:uppercase;
268
+ color:var(--accent);
269
+ margin-bottom:6px;
270
+ }
271
+
272
+ .tile-sub{
273
+ font-size:.9rem;
274
+ color:var(--text-soft);
275
+ }
276
+
277
+ @media(max-width:600px){
278
+ .container{
279
+ padding:32px 24px;
280
+ }
281
+ .card{
282
+ padding:22px;
283
+ }
284
+ }
285
+
286
+ </style>