Hugging Face's logo

DoppelReflEx
/
MiniusLight-24B

Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
text-generation-inference
Model card Files
xet
Community
DoppelReflEx commited on
Commit
cc9f621
·
verified ·
1 Parent(s): 26bb7f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +142 -31
README.md CHANGED
@@ -6,35 +6,146 @@ library_name: transformers
6
  tags:
7
  - mergekit
8
  - merge
9
-
10
  ---
11
- # merge
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [TheDrummer/Cydonia-24B-v2](https://huggingface.co/TheDrummer/Cydonia-24B-v2)
24
- * [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
25
-
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
- models:
32
- - model: TheDrummer/Cydonia-24B-v2
33
- - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
34
- merge_method: slerp
35
- base_model: TheDrummer/Cydonia-24B-v2
36
- parameters:
37
- t: [0.1, 0.3, 0.6, 0.3, 0.1]
38
- dtype: bfloat16
39
-
40
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  tags:
7
  - mergekit
8
  - merge
9
+ license: cc-by-nc-4.0
10
  ---
11
+ <style>
12
+ @import url('https://fonts.googleapis.com/css2?family=Playwrite+CA+Guides&display=swap');
13
+ .playwrite-ca-guides-regular {
14
+ font-family: "Playwrite CA Guides", cursive !important;
15
+ font-weight: 400;
16
+ font-style: normal;
17
+ }
18
+ body {
19
+ margin:0;
20
+ padding:0;
21
+ font-size: 16px;
22
+ }
23
+ .main-container {
24
+ background-color: #ebf3ff;
25
+ border: 1px solid #466db9;
26
+ border-radius: 8px;
27
+ color: #050315;
28
+ margin:16px;
29
+ padding:16px;
30
+ font-size: 16px;
31
+ width: 95%;
32
+ }
33
+ h1, h2, h3 {
34
+ color: #050315;
35
+ margin-top: 16px;
36
+ }
37
+ .soft-blue-custom {
38
+ color: #466db9 !important;
39
+ }
40
+ .alink {
41
+ font-weight:400;
42
+ text-decoration:none;
43
+ }
44
+ .main-banner-image {
45
+ max-width:80%;
46
+ border-radius:8px;
47
+ align-self:center;
48
+ justify-self: center;
49
+ border: 1px solid #466db9;
50
+ margin: 8px 16px
51
+ }
52
+ pre.code-block, pre {
53
+ font-size: clamp(10px, 1.3vw, 14px);
54
+ white-space: pre;
55
+ margin: 1em 0;
56
+ background-color: #1a1a1a;
57
+ padding: 1em;
58
+ border-radius: 4px;
59
+ color: #a9a6de;
60
+ overflow-x: auto;
61
+ }
62
+ p {
63
+ font-weight:500;
64
+ }
65
+ .pb {
66
+ padding-bottom: 8px;
67
+ }
68
+ .mb {
69
+ margin-bottom: 8px;
70
+ }
71
+ .bold {
72
+ font-weight: 600;
73
+ }
74
+ .secondary {
75
+ color: #a9a6de;
76
+ }
77
+ .accent {
78
+ color: #403bb7;
79
+ }
80
+ .tac {
81
+ text-align:center;
82
+ }
83
+ .border-custom-dot {
84
+ border: 1px dashed #466db9;
85
+ border-radius: 16px;
86
+ padding:0 8px;
87
+ }
88
+ .border-custom {
89
+ border: 1px solid #466db9;
90
+ border-radius: 8px;
91
+ padding:0 8px;
92
+ }
93
+ .as {
94
+ padding-left: 16px;
95
+ }
96
+ .as2 {
97
+ padding-left: 24px;
98
+ }
99
+ </style>
100
+ <html lang="en">
101
+ <head>
102
+ <meta charset="UTF-8">
103
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
104
+ <link href="https://fonts.googleapis.com/css2?family=Playwrite+CA+Guides&display=swap" rel="stylesheet">
105
+ </head>
106
+ <body>
107
+ <div class="main-container">
108
+ <div class="playwrite-ca-guides-regular pb tac">
109
+ <h1 class="soft-blue-custom">MiniusLight-24B</h1>
110
+ <h2 class="accent"><a href="https://huggingface.co/DoppelReflEx/MN-12B-Mimicore-Nocturne" class="soft-blue-custom">12B</a> - 24B</h2>
111
+ <img src="https://img3.gelbooru.com/images/ec/af/ecafd7749bf946917190f98f609a9f47.jpg" alt="cover image" class="main-banner-image"/>
112
+ <a href="https://twitter.com/void_ling/status/1855164935141200230" class="alink soft-blue-custom">Origin Content</a>
113
+ </div>
114
+ <div class="info">
115
+ <div class="border-custom-dot mb">
116
+ <h2 class="soft-blue-custom">What is this?</h2>
117
+ <div class="as">
118
+ <p>
119
+ A nice, simple Slerp merge of 2 Mistral "Small" model and well-known HuggingFace users, <a class="alink soft-blue-custom bold" href="https://huggingface.co/TheDrummer/Cydonia-24B-v2">TheDrummer/Cydonia-24B-v2</a>
120
+ <span class="secondary">&</span>
121
+ <a class="alink soft-blue-custom bold" href="https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b">PocketDoc/Dans-PersonalityEngine-V1.2.0-24b</a>.
122
+ </p>
123
+ <p>This version is the best merge version and recipe I have tried with a good eval scores. Strong in ERP, RP, Story Writing and orther purpose.</p>
124
+ <p>Overall, nice to try model, if you want to try. :)</p>
125
+ </div>
126
+ </div>
127
+ <div class="border-custom-dot">
128
+ <h2 class="soft-blue-custom">Other information</h2>
129
+ <div class="as">
130
+ <h3><span class="soft-blue-custom">Chat Template? </span>ChatML<span class="soft-blue-custom">, of course!</span></h3>
131
+ <h3 class="soft-blue-custom">Merge Method<h3/>
132
+ <details class="border-custom">
133
+ <summary class="soft-blue-custom">Detail YAML Config</summary>
134
+ <pre>
135
+ {
136
+ models:
137
+ - model: TheDrummer/Cydonia-24B-v2
138
+ - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
139
+ merge_method: slerp
140
+ base_model: TheDrummer/Cydonia-24B-v2
141
+ parameters:
142
+ t: [0.1, 0.3, 0.6, 0.3, 0.1]
143
+ dtype: bfloat16
144
+ }
145
+ </pre>
146
+ </detail>
147
+ </div>
148
+ </div>
149
+ </div>
150
+ </div>
151
+ </body>