Vortex5 commited on
Commit
b638e0d
·
verified ·
1 Parent(s): c134e22

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +207 -15
README.md CHANGED
@@ -8,30 +8,183 @@ library_name: transformers
8
  tags:
9
  - mergekit
10
  - merge
11
-
12
  ---
13
- # merge
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
 
 
 
16
 
17
- ## Merge Details
18
- ### Merge Method
19
 
20
- This model was merged using the flowsync merge method using [Vortex5/Harmony-Bird-12B](https://huggingface.co/Vortex5/Harmony-Bird-12B) as a base.
 
 
 
 
 
 
 
 
21
 
22
- ### Models Merged
23
 
24
- The following models were included in the merge:
25
- * [Vortex5/Crimson-Twilight-12B](https://huggingface.co/Vortex5/Crimson-Twilight-12B)
26
- * [Vortex5/Luminous-Shadow-12B](https://huggingface.co/Vortex5/Luminous-Shadow-12B)
27
- * [Vortex5/Velvet-Orchid-12B](https://huggingface.co/Vortex5/Velvet-Orchid-12B)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
 
29
- ### Configuration
30
 
31
- The following YAML configuration was used to produce this model:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
- ```yaml
34
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
35
  models:
36
  - model: Vortex5/Luminous-Shadow-12B
37
  parameters:
@@ -61,5 +214,44 @@ parameters:
61
  balance: 0.5
62
  tokenizer:
63
  source: Vortex5/Harmony-Bird-12B
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
64
 
65
- ```
 
 
 
 
 
 
 
 
 
 
 
8
  tags:
9
  - mergekit
10
  - merge
11
+ - roleplay
12
  ---
13
+ <style>
14
+ @import url('https://fonts.googleapis.com/css2?family=Cinzel+Decorative:wght@700&family=Uncial+Antiqua&family=MedievalSharp&display=swap');
15
+
16
+ :root {
17
+ --bg-deep:#040705;
18
+ --bg-mid:#0a0f0a;
19
+ --bg-top:#111a12;
20
+ --emerald:#7fffb0;
21
+ --mint:#caffdc;
22
+ --gold:#f8e4a3;
23
+ --text-main:#eaf7ec;
24
+ --text-dim:#a7bfae;
25
+ }
26
+
27
+
28
+ *{box-sizing:border-box;}
29
+ .draconic-wrap {
30
+ position:relative;
31
+ margin:60px auto;
32
+ max-width:1100px;
33
+ padding:48px;
34
+ font-family:"MedievalSharp","Cinzel Decorative","Uncial Antiqua",serif;
35
+ color:var(--text-main);
36
+ background:radial-gradient(circle at 60% 20%,var(--bg-top),var(--bg-mid) 55%,var(--bg-deep) 100%);
37
+ border-radius:20px;
38
+ border:2px solid var(--emerald);
39
+ box-shadow:
40
+ 0 0 15px rgba(60,90,60,0.3),
41
+ 0 0 90px rgba(90,255,160,0.15),
42
+ inset 0 0 100px rgba(90,200,130,0.08);
43
+ }
44
+
45
+
46
+ .title-container {
47
+ text-align: center;
48
+ margin-bottom: 40px;
49
+ }
50
+
51
+ .title-main {
52
+ margin: 0;
53
+ font-size: 3.2rem;
54
+ letter-spacing: 3px;
55
+ text-transform: uppercase;
56
+ font-family: "Cinzel Decorative", serif;
57
+ color: var(--mint);
58
+ text-shadow:
59
+ 0 0 6px rgba(120,255,180,0.7),
60
+ 0 0 14px rgba(80,200,140,0.5),
61
+ 0 0 25px rgba(100,255,180,0.4),
62
+ 0 0 50px rgba(90,255,160,0.2);
63
+ background: none;
64
+ }
65
 
66
+ .subtitle {
67
+ margin-top: .6rem;
68
+ color: var(--text-dim);
69
+ font-style: italic;
70
+ text-shadow: 0 0 5px rgba(100,255,180,.3);
71
+ }
72
 
 
 
73
 
74
+ .hero{text-align:center;margin:30px auto;}
75
+ .hero img{
76
+ max-width:95%;
77
+ border-radius:14px;
78
+ border:2px solid var(--emerald);
79
+ box-shadow:
80
+ 0 0 40px rgba(100,240,170,.25),
81
+ inset 0 0 8px rgba(80,200,130,.1);
82
+ }
83
 
 
84
 
85
+ .section{
86
+ margin:35px 0;
87
+ padding:28px 30px;
88
+ border-radius:14px;
89
+ background:linear-gradient(180deg,rgba(8,12,8,.92),rgba(6,9,6,.97));
90
+ border:1px solid rgba(90,220,150,.25);
91
+ box-shadow:
92
+ inset 0 0 25px rgba(0,0,0,.7),
93
+ 0 0 40px rgba(90,220,150,.1);
94
+ }
95
+ .section-header{
96
+ padding-bottom:10px;
97
+ border-bottom:1px solid rgba(100,255,180,.15);
98
+ margin-bottom:10px;
99
+ }
100
+ .section-title{
101
+ font-family:"Uncial Antiqua",serif;
102
+ font-size:1.7rem;
103
+ letter-spacing:3px;
104
+ text-transform:uppercase;
105
+ color:var(--mint);
106
+ text-shadow:
107
+ 0 0 8px rgba(150,255,200,.6),
108
+ 0 0 18px rgba(100,240,160,.4);
109
+ }
110
+ .section-content p{
111
+ line-height:1.7;
112
+ color:var(--text-main);
113
+ text-shadow:0 0 5px rgba(80,150,100,.25);
114
+ }
115
 
 
116
 
117
+ details{
118
+ margin-top:14px;
119
+ border:1px solid rgba(120,250,180,.25);
120
+ border-radius:10px;
121
+ background:linear-gradient(180deg,rgba(15,20,15,.7),rgba(10,15,10,.85));
122
+ padding:10px 14px;
123
+ }
124
+ summary{
125
+ cursor:pointer;
126
+ font-family:"Cinzel Decorative",serif;
127
+ font-weight:600;
128
+ color:var(--mint);
129
+ text-shadow:0 0 8px rgba(120,255,180,.4);
130
+ list-style:none;
131
+ }
132
+ details summary::-webkit-details-marker{display:none;}
133
+ details > summary::before{
134
+ content:"▸";padding-right:6px;opacity:.8;
135
+ }
136
+ details[open] > summary::before{transform:rotate(90deg);}
137
+ pre{
138
+ background:#0a0f0a;
139
+ color:var(--text-main);
140
+ padding:16px 22px;
141
+ border-left:3px solid var(--emerald);
142
+ border-radius:8px;
143
+ overflow:auto;
144
+ font-size:13px;
145
+ box-shadow:inset 0 0 18px rgba(0,0,0,.7);
146
+ }
147
 
 
148
 
149
+ a{
150
+ color:var(--mint);
151
+ text-decoration:none;
152
+ border-bottom:1px dotted rgba(150,255,200,.4);
153
+ }
154
+ a:hover{
155
+ color:var(--gold);
156
+ text-shadow:0 0 8px rgba(200,255,220,.7);
157
+ }
158
+ ul{list-style:none;padding-left:10px;margin:0;}
159
+ </style>
160
+
161
+ <div class="draconic-wrap">
162
+ <div class="title-container">
163
+ <h1 class="title-main">Emerald Wyvern</h1>
164
+ </div>
165
+
166
+ <div class="hero">
167
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/2Md7RGyGnEaASRPyYVfba.png" alt="Shadowed-Wyvern"/>
168
+ </div>
169
+
170
+ <div class="section">
171
+ <div class="section-header"><h2 class="section-title">Overview</h2></div>
172
+ <div class="section-content">
173
+ <p><b>Emerald-Wyvern-12B</b> was made with a custom method, it merges —
174
+ <a href="https://huggingface.co/Vortex5/Luminous-Shadow-12B">Luminous-Shadow-12B</a>,
175
+ <a href="https://huggingface.co/Vortex5/Velvet-Orchid-12B">Velvet-Orchid-12B</a>, and
176
+ <a href="https://huggingface.co/Vortex5/Crimson-Twilight-12B">Crimson-Twilight-12B</a>,
177
+ using <a href="https://huggingface.co/Vortex5/Harmony-Bird-12B">Harmony-Bird-12B</a> as a base.
178
+ </p>
179
+ </div>
180
+ </div>
181
+
182
+ <div class="section">
183
+ <div class="section-header"><h2 class="section-title">Merge Configuration</h2></div>
184
+ <div class="section-content">
185
+ <details>
186
+ <summary>Expand YAML Configuration</summary>
187
+ <pre><code>
188
  models:
189
  - model: Vortex5/Luminous-Shadow-12B
190
  parameters:
 
214
  balance: 0.5
215
  tokenizer:
216
  source: Vortex5/Harmony-Bird-12B
217
+ </code></pre>
218
+ </details>
219
+ </div>
220
+ </div>
221
+
222
+ <div class="section">
223
+ <div class="section-header"><h2 class="section-title">Custom Merge Method</h2></div>
224
+ <div class="section-content">
225
+ <details>
226
+ <summary>About</summary>
227
+
228
+ <h1 style="margin-top: 30px;">FlowSync</h1>
229
+
230
+ <p class="concept">
231
+ <strong>Concept:</strong> A coherence-weighted tensor merge algorithm that aligns donor model deltas
232
+ relative to a shared base, computes pairwise cosine similarities to measure inter-model agreement,
233
+ and aggregates them along the highest-consensus direction in parameter space. It reinforces semantically
234
+ consistent weight shifts while suppressing incoherent or noisy deviations using adaptive temperature scaling,
235
+ semantic gating (Nyström eigenvector extraction), and MAD-based normalization.
236
+ </p>
237
+
238
+ <h2>Key Parameters</h2>
239
+ <ul class="param-list">
240
+ <li><code>strength</code> (global): Scales how far the merged tensor moves from the base toward the consensus vector. Higher values emphasize donor influence.</li>
241
+ <li><code>balance</code> (global): Modulates bias between logic-dominant (attention/MLP) and style-dominant (embedding/output) layers.</li>
242
+ </ul>
243
+ </details>
244
+ </div>
245
+ </div>
246
 
247
+ <div class="section">
248
+ <div class="section-header"><h2 class="section-title">Credits</h2></div>
249
+ <div class="section-content">
250
+ <ul>
251
+ <li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li>
252
+ <li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
253
+ <li><strong><a>Original creators and model authors</a></strong></li>
254
+ </ul>
255
+ </div>
256
+ </div>
257
+ </div>