Hugging Face's logo

Delta-Vector
/
Shimamura-70B

Safetensors
llama
roleplay
chat
creative-writing
Model card Files
xet
Community
2
Delta-Vector commited on
Commit
e01ee44
·
verified ·
1 Parent(s): 518e979

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +378 -0
README.md ADDED
@@ -0,0 +1,378 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - Delta-Vector/Orion-Misc-Data-Sharegpt-Prefixed
4
+ - Delta-Vector/Orion-Basket-Weaving-Filtered
5
+ - Delta-Vector/Orion-vanilla-backrooms-claude-sharegpt
6
+ - Delta-Vector/Orion-Roleplay-Logs-Sharegpt-Ngram-cleaned
7
+ - Delta-Vector/Orion-BlueSky-10K-Complexity
8
+ base_model:
9
+ - zerofata/L3.3-GeneticLemonade-Unleashed-v3-70B
10
+ ---
11
+ <!DOCTYPE html>
12
+ <html lang="en">
13
+ <head>
14
+ <meta charset="UTF-8">
15
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
16
+ <title>Sol-Reaver 15B</title>
17
+ <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
18
+ <style>
19
+ body {
20
+ font-family: 'Quicksand', sans-serif;
21
+ background: linear-gradient(135deg, #e8f8f5 0%, #e6f7ff 50%, #f0f8f0 100%);
22
+ color: #2d5a4a;
23
+ margin: 0;
24
+ padding: 0;
25
+ font-size: 16px;
26
+ min-height: 100vh;
27
+ }
28
+ .container {
29
+ margin: 20px;
30
+ background: linear-gradient(145deg, rgba(255, 255, 255, 0.9), rgba(240, 255, 250, 0.95));
31
+ padding: 30px;
32
+ border-radius: 20px;
33
+ box-shadow: 0 8px 32px rgba(144, 238, 144, 0.3), 0 4px 16px rgba(173, 216, 230, 0.2);
34
+ border: 2px solid rgba(144, 238, 144, 0.4);
35
+ position: relative;
36
+ backdrop-filter: blur(10px);
37
+ }
38
+ .container::before {
39
+ content: '';
40
+ position: absolute;
41
+ top: 0;
42
+ left: 0;
43
+ right: 0;
44
+ bottom: 0;
45
+ background: linear-gradient(45deg, rgba(144, 238, 144, 0.1), rgba(173, 216, 230, 0.1), rgba(152, 251, 152, 0.1));
46
+ border-radius: 20px;
47
+ z-index: -1;
48
+ }
49
+ .header h1 {
50
+ font-size: 32px;
51
+ background: linear-gradient(45deg, #20b2aa, #4169e1, #32cd32);
52
+ -webkit-background-clip: text;
53
+ -webkit-text-fill-color: transparent;
54
+ background-clip: text;
55
+ margin: 0 0 20px 0;
56
+ text-align: center;
57
+ font-weight: 600;
58
+ text-shadow: 0 2px 4px rgba(144, 238, 144, 0.3);
59
+ }
60
+ .section {
61
+ margin-top: 30px;
62
+ }
63
+ .section h2 {
64
+ font-size: 24px;
65
+ background: linear-gradient(45deg, #20b2aa, #4169e1);
66
+ -webkit-background-clip: text;
67
+ -webkit-text-fill-color: transparent;
68
+ background-clip: text;
69
+ text-align: center;
70
+ font-weight: 600;
71
+ margin-bottom: 20px;
72
+ }
73
+ .info p {
74
+ color: #2d5a4a;
75
+ line-height: 1.8;
76
+ font-size: 16px;
77
+ }
78
+ .info img {
79
+ width: 85%;
80
+ border-radius: 15px;
81
+ margin: 0 auto 15px;
82
+ display: block;
83
+ box-shadow: 0 8px 25px rgba(144, 238, 144, 0.4);
84
+ border: 2px solid rgba(152, 251, 152, 0.5);
85
+ }
86
+ a {
87
+ color: #20b2aa;
88
+ text-decoration: none;
89
+ transition: all 0.3s ease;
90
+ font-weight: 500;
91
+ }
92
+ a:hover {
93
+ color: #4169e1;
94
+ text-shadow: 0 0 8px rgba(173, 216, 230, 0.6);
95
+ }
96
+ .button {
97
+ display: inline-block;
98
+ background: linear-gradient(45deg, #b0e0e6, #98fb98);
99
+ color: #2d5a4a;
100
+ padding: 12px 24px;
101
+ border-radius: 25px;
102
+ cursor: pointer;
103
+ text-decoration: none;
104
+ transition: all 0.3s ease;
105
+ border: 1px solid rgba(144, 238, 144, 0.5);
106
+ font-weight: 500;
107
+ }
108
+ .button:hover {
109
+ background: linear-gradient(45deg, #87ceeb, #90ee90);
110
+ box-shadow: 0 4px 15px rgba(144, 238, 144, 0.6);
111
+ transform: translateY(-2px);
112
+ }
113
+ pre {
114
+ background: linear-gradient(135deg, rgba(240, 255, 255, 0.8), rgba(240, 255, 240, 0.8));
115
+ padding: 20px;
116
+ border-radius: 12px;
117
+ overflow-x: auto;
118
+ border: 1px solid rgba(144, 238, 144, 0.3);
119
+ box-shadow: inset 0 2px 4px rgba(144, 238, 144, 0.2);
120
+ }
121
+ code {
122
+ font-family: 'Courier New', monospace;
123
+ color: #2d5a4a;
124
+ }
125
+ .info-card {
126
+ background: linear-gradient(145deg, rgba(240, 255, 255, 0.9), rgba(240, 255, 240, 0.9));
127
+ border: 2px solid rgba(144, 238, 144, 0.4);
128
+ border-radius: 15px;
129
+ overflow: hidden;
130
+ box-shadow: 0 4px 20px rgba(144, 238, 144, 0.3);
131
+ }
132
+ .info-header {
133
+ background: linear-gradient(135deg, rgba(152, 251, 152, 0.3), rgba(173, 216, 230, 0.2));
134
+ padding: 25px;
135
+ border-bottom: 1px solid rgba(144, 238, 144, 0.3);
136
+ }
137
+ .info-header h3 {
138
+ background: linear-gradient(45deg, #20b2aa, #4169e1);
139
+ -webkit-background-clip: text;
140
+ -webkit-text-fill-color: transparent;
141
+ background-clip: text;
142
+ margin: 0 0 15px 0;
143
+ font-size: 22px;
144
+ text-align: center;
145
+ font-weight: 600;
146
+ }
147
+ .model-tags {
148
+ display: flex;
149
+ gap: 10px;
150
+ flex-wrap: wrap;
151
+ justify-content: center;
152
+ }
153
+ .model-tag {
154
+ background: linear-gradient(45deg, rgba(144, 238, 144, 0.4), rgba(173, 216, 230, 0.3));
155
+ color: #2d5a4a;
156
+ padding: 8px 16px;
157
+ border-radius: 20px;
158
+ font-size: 13px;
159
+ border: 1px solid rgba(144, 238, 144, 0.5);
160
+ font-weight: 500;
161
+ box-shadow: 0 2px 8px rgba(144, 238, 144, 0.2);
162
+ }
163
+ .model-composition {
164
+ padding: 25px;
165
+ border-bottom: 1px solid rgba(144, 238, 144, 0.3);
166
+ }
167
+ .model-composition h4 {
168
+ background: linear-gradient(45deg, #20b2aa, #4169e1);
169
+ -webkit-background-clip: text;
170
+ -webkit-text-fill-color: transparent;
171
+ background-clip: text;
172
+ margin: 0 0 20px 0;
173
+ font-size: 18px;
174
+ text-align: center;
175
+ font-weight: 600;
176
+ }
177
+ .composition-list {
178
+ list-style: none;
179
+ padding: 0;
180
+ margin: 0;
181
+ display: grid;
182
+ gap: 15px;
183
+ }
184
+ .composition-list li {
185
+ color: #2d5a4a;
186
+ display: flex;
187
+ align-items: baseline;
188
+ gap: 12px;
189
+ padding: 10px;
190
+ background: rgba(240, 255, 255, 0.5);
191
+ border-radius: 8px;
192
+ border-left: 4px solid #b0e0e6;
193
+ }
194
+ .model-component {
195
+ font-weight: 600;
196
+ min-width: 120px;
197
+ }
198
+ .model-description {
199
+ padding: 25px;
200
+ background: linear-gradient(135deg, rgba(255, 255, 255, 0.7), rgba(240, 255, 255, 0.8));
201
+ }
202
+ .metrics-section {
203
+ margin-bottom: 30px;
204
+ }
205
+ .metrics-section details {
206
+ background: linear-gradient(145deg, rgba(240, 255, 255, 0.9), rgba(240, 255, 240, 0.9));
207
+ border: 2px solid rgba(144, 238, 144, 0.4);
208
+ border-radius: 12px;
209
+ padding: 20px;
210
+ margin-bottom: 20px;
211
+ box-shadow: 0 4px 15px rgba(144, 238, 144, 0.2);
212
+ }
213
+ .metrics-section summary {
214
+ background: linear-gradient(45deg, #20b2aa, #4169e1);
215
+ -webkit-background-clip: text;
216
+ -webkit-text-fill-color: transparent;
217
+ background-clip: text;
218
+ font-size: 18px;
219
+ cursor: pointer;
220
+ outline: none;
221
+ padding: 8px 0;
222
+ text-align: center;
223
+ font-weight: 600;
224
+ transition: all 0.3s ease;
225
+ }
226
+ .metrics-section summary:hover {
227
+ text-shadow: 0 0 8px rgba(173, 216, 230, 0.6);
228
+ }
229
+ .creator-section {
230
+ margin: 20px 0;
231
+ text-align: center;
232
+ }
233
+ .creator-badge {
234
+ display: inline-flex;
235
+ align-items: center;
236
+ background: linear-gradient(145deg, rgba(240, 255, 255, 0.9), rgba(240, 255, 240, 0.9));
237
+ border: 2px solid rgba(144, 238, 144, 0.4);
238
+ border-radius: 25px;
239
+ padding: 15px 20px;
240
+ box-shadow: 0 4px 15px rgba(144, 238, 144, 0.3);
241
+ }
242
+ .creator-label {
243
+ color: #2d5a4a;
244
+ font-size: 14px;
245
+ margin-right: 10px;
246
+ font-weight: 500;
247
+ }
248
+ .creator-link {
249
+ display: flex;
250
+ align-items: center;
251
+ gap: 8px;
252
+ color: #20b2aa;
253
+ text-decoration: none;
254
+ transition: all 0.3s ease;
255
+ }
256
+ .creator-name {
257
+ font-weight: 600;
258
+ }
259
+ .creator-arrow {
260
+ font-size: 16px;
261
+ transition: transform 0.3s ease;
262
+ }
263
+ .creator-link:hover .creator-arrow {
264
+ transform: translateX(4px);
265
+ color: #4169e1;
266
+ }
267
+ .creator-link:hover {
268
+ color: #4169e1;
269
+ text-shadow: 0 0 8px rgba(173, 216, 230, 0.6);
270
+ }
271
+ .link-arrow {
272
+ display: inline-block;
273
+ transition: transform 0.3s ease;
274
+ }
275
+ a:hover .link-arrow {
276
+ transform: translateX(3px);
277
+ }
278
+ .axolotl-container {
279
+ display: flex;
280
+ text-align: center;
281
+ justify-content: center;
282
+ margin: 30px 0;
283
+ }
284
+ .axolotl-container img {
285
+ max-width: 300px;
286
+ border-radius: 15px;
287
+ box-shadow: 0 6px 20px rgba(144, 238, 144, 0.4);
288
+ border: 2px solid rgba(152, 251, 152, 0.5);
289
+ transition: transform 0.3s ease;
290
+ display: block;
291
+ margin: 0 auto;
292
+ }
293
+ .axolotl-container img:hover {
294
+ transform: scale(1.05);
295
+ }
296
+ </style>
297
+ </head>
298
+ <body>
299
+ <div class="container">
300
+ <div class="header">
301
+ <h1>Sol Reaver 15B</h1>
302
+ </div>
303
+ <div class="info">
304
+ <img src="" alt="Model banner">
305
+ <div style="text-align: center;">
306
+ <div class="creator-section">
307
+ <div class="creator-badge">
308
+ <span class="creator-label">Created by</span>
309
+ <a href="https://huggingface.co/Delta-Vector" target="_blank" class="creator-link">
310
+ <span class="creator-name">Delta-Vector</span>
311
+ <span class="creator-arrow">→</span>
312
+ </a>
313
+ </div>
314
+ </div>
315
+ <div class="model-info">
316
+ <h2>Model Information</h2>
317
+ <div class="info-card">
318
+ <div class="info-header">
319
+ <h3>Shimamura-70B</h3>
320
+ <div class="model-tags">
321
+ <span class="model-tag">70B parameters</span>
322
+ <span class="model-tag">Creative / Funny</span>
323
+ <span class="model-tag">Chat Model</span>
324
+ </div>
325
+ </div>
326
+ <div class="model-description">
327
+ <p>This is a Finetune of zerofata/L3.3-GeneticLemonade-Unleashed-v3-70B to be a good Chat Model at a larger parameter size</p>
328
+ <p>This model has been trained on 100M tokens of Human chat logs from Bsky, 4chan & Most of all ShoujoAI.</p>
329
+ <p>Support me on Ko-Fi: https://ko-fi.com/deltavector</p>
330
+ </div>
331
+ </div>
332
+ </div>
333
+ <div class="section">
334
+ <h2>Quantized Versions</h2>
335
+ <div class="info-card">
336
+ <div class="model-composition">
337
+ <h4>Available Downloads</h4>
338
+ <ul class="composition-list">
339
+ <li><span class="model-component"><a href="" target="_blank">GGUF Format</a></span>For use with LLama.cpp & Forks(Coming Soon!)</li>
340
+ <li><span class="model-component"><a href="" target="_blank">EXL2 Format</a></span>For use with TabbyAPI (Coming Soon!)</li>
341
+ <li><span class="model-component"><a href="" target="_blank">EXL3 Format</a></span>For use with TabbyAPI (Slower on Ampere))</li>
342
+ </ul>
343
+ </div>
344
+ </div>
345
+ </div>
346
+ <div class="section">
347
+ <h2>Prompting</h2>
348
+ <p>Model has been tuned with the Llama-3-Instruct formatting.</p>
349
+ </div>
350
+ <div class="section">
351
+ <h2>Samplers</h2>
352
+ <p>For testing of this model, I used Temp=1, 0.1 Min-P.</p>
353
+ <div class="metrics-section">
354
+ <details>
355
+ <summary>See Axolotl Config</summary>
356
+ <pre><code>
357
+ https://wandb.ai/new-eden/austral/artifacts/axolotl-config/config-c61un0ze/v0/files/axolotl_config_cu4t7u4q.yml
358
+ </code></pre>
359
+ </details>
360
+ </div>
361
+ </div>
362
+ <div class="section">
363
+ <h2>Training</h2>
364
+ <p>The training was done for 4 epoch using 8 x <a href="https://www.nvidia.com/en-us/data-center/h200/">H200s</a> GPUs for the fine-tuning of the model.</p>
365
+ <div class="axolotl-container">
366
+ <a href="https://github.com/OpenAccess-AI-Collective/axolotl" target="_blank">
367
+ <img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl">
368
+ </a>
369
+ </div>
370
+ </div>
371
+ <div class="section">
372
+ <h2>Credits</h2>
373
+ <p>Thank you to <a href="https://huggingface.co/lucyknada">Lucy Knada</a>, <a href="https://huggingface.co/zerofata">Zerofata</a>, <a href="https://huggingface.co/AuriAetherwiing">Auri</a>, <a href="https://huggingface.co/intervitens">Intervitens</a>, <a href="https://huggingface.co/cgato">Cgato</a>, <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a> and the rest of <a href="https://huggingface.co/anthracite-org">Anthracite</a>.</p>
374
+ </div>
375
+ </div>
376
+ </div>
377
+ </body>
378
+ </html>