DoppelReflEx commited on
Commit
d1ef2e7
·
verified ·
1 Parent(s): 879ce1b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +154 -41
README.md CHANGED
@@ -9,44 +9,157 @@ tags:
9
  - merge
10
 
11
  ---
12
- # merge
13
-
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
-
16
- ## Merge Details
17
- ### Merge Method
18
-
19
- This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using [TroyDoesAI/BlackSheep-24B](https://huggingface.co/TroyDoesAI/BlackSheep-24B) as a base.
20
-
21
- ### Models Merged
22
-
23
- The following models were included in the merge:
24
- * [TheDrummer/Cydonia-24B-v2](https://huggingface.co/TheDrummer/Cydonia-24B-v2)
25
- * [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
26
-
27
- ### Configuration
28
-
29
- The following YAML configuration was used to produce this model:
30
-
31
- ```yaml
32
- models:
33
- - model: TroyDoesAI/BlackSheep-24B
34
- parameters:
35
- density: 0.9
36
- weight: 1
37
- - model: TheDrummer/Cydonia-24B-v2
38
- parameters:
39
- density: 0.6
40
- weight: 0.8
41
- - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
42
- parameters:
43
- density: 0.8
44
- weight: 0.6
45
- merge_method: dare_ties
46
- base_model: TroyDoesAI/BlackSheep-24B
47
- tokenizer_source: base
48
- parameters:
49
- rescale: true
50
- dtype: bfloat16
51
-
52
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - merge
10
 
11
  ---
12
+ <style>
13
+ @import url('https://fonts.googleapis.com/css2?family=Playwrite+CA+Guides&display=swap');
14
+ .playwrite-ca-guides-regular {
15
+ font-family: "Playwrite CA Guides", cursive !important;
16
+ font-weight: 400;
17
+ font-style: normal;
18
+ }
19
+ body {
20
+ margin:0;
21
+ padding:0;
22
+ font-size: 16px;
23
+ }
24
+ .main-container {
25
+ background-color: #ebf3ff;
26
+ border: 1px solid #466db9;
27
+ border-radius: 8px;
28
+ color: #050315;
29
+ margin:16px;
30
+ padding:16px;
31
+ font-size: 16px;
32
+ width: 95%;
33
+ }
34
+ h1, h2, h3 {
35
+ color: #050315;
36
+ margin-top: 16px;
37
+ }
38
+ .soft-blue-custom {
39
+ color: #466db9 !important;
40
+ }
41
+ .alink {
42
+ font-weight:400;
43
+ text-decoration:none;
44
+ }
45
+ .main-banner-image {
46
+ max-width:100%;
47
+ border-radius:8px;
48
+ align-self:center;
49
+ justify-self: center;
50
+ border: 1px solid #466db9;
51
+ margin: 8px 16px
52
+ }
53
+ pre.code-block, pre {
54
+ font-size: clamp(10px, 1.3vw, 14px);
55
+ white-space: pre;
56
+ margin: 1em 0;
57
+ background-color: #1a1a1a;
58
+ padding: 1em;
59
+ border-radius: 4px;
60
+ color: #a9a6de;
61
+ overflow-x: auto;
62
+ }
63
+ p {
64
+ font-weight:500;
65
+ }
66
+ .pb {
67
+ padding-bottom: 8px;
68
+ }
69
+ .mb {
70
+ margin-bottom: 8px;
71
+ }
72
+ .bold {
73
+ font-weight: 600;
74
+ }
75
+ .secondary {
76
+ color: #a9a6de;
77
+ }
78
+ .accent {
79
+ color: #403bb7;
80
+ }
81
+ .tac {
82
+ text-align:center;
83
+ }
84
+ .border-custom-dot {
85
+ border: 1px dashed #466db9;
86
+ border-radius: 16px;
87
+ padding:0 8px;
88
+ }
89
+ .border-custom {
90
+ border: 1px solid #466db9;
91
+ border-radius: 8px;
92
+ padding:0 8px;
93
+ }
94
+ .as {
95
+ padding-left: 16px;
96
+ }
97
+ .as2 {
98
+ padding-left: 24px;
99
+ }
100
+ </style>
101
+ <html lang="en">
102
+ <head>
103
+ <meta charset="UTF-8">
104
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
105
+ <link href="https://fonts.googleapis.com/css2?family=Playwrite+CA+Guides&display=swap" rel="stylesheet">
106
+ </head>
107
+ <body>
108
+ <div class="main-container">
109
+ <div class="playwrite-ca-guides-regular pb tac">
110
+ <h1 class="soft-blue-custom">MiniusLight-24B-v2</h1>
111
+ <h2 class="soft-blue-custom"><a href="https://huggingface.co/DoppelReflEx/MN-12B-Mimicore-Nocturne" class="accent bold">12B</a> - <a href="https://huggingface.co/DoppelReflEx/MiniusLight-24B" class="accent bold">24B-v1</a> - <a href="https://huggingface.co/DoppelReflEx/MiniusLight-24B-v1.01" class="accent bold">24B-v1.01</a> - <a href="https://huggingface.co/DoppelReflEx/MiniusLight-24B-v2" class="accent bold">24B-v2</a> - 24B-v2.1</h2>
112
+ <img src="https://cdn.donmai.us/original/8c/1f/__shorekeeper_wuthering_waves_drawn_by_void_0__8c1f85311759aea5d15ebe12bcfcab32.jpg" alt="cover image" class="main-banner-image"/>
113
+ <a href="https://twitter.com/void_ling/status/1855164935141200230" class="alink soft-blue-custom">Origin Content (Click Here)</a>
114
+ </div>
115
+ <div class="info">
116
+ <div class="border-custom-dot mb">
117
+ <h2 class="soft-blue-custom">What is this?</h2>
118
+ <div class="as">
119
+ <p>
120
+ A merge of most uncensored model TroyDoesAI/BlackSheep-24B and recipe of MiniusLight-24B: TheDrummer/Cydonia-24B-v2 and PocketDoc/Dans-PersonalityEngine-V1.2.0-24b.
121
+ </p>
122
+ <p>Another version of v2, but far better than it. Vivid writing styles, and talk back to me, sometimes hard to control it. (Maybe just because my character card)</p>
123
+ <p>Best model of the series (for me). :)</p>
124
+ </div>
125
+ </div>
126
+ <div class="border-custom-dot mb">
127
+ <h2 class="soft-blue-custom">GGUF</h2>
128
+ <h3 class="accent"><a href="https://huggingface.co/mradermacher/MiniusLight-24B-v1.01-GGUF" class="accent bold">Static</a> - <a class="accent bold" href="https://huggingface.co/mradermacher/MiniusLight-24B-v1.01-i1-GGUF">iMatrix</a></h3>
129
+ </div>
130
+ <div class="border-custom-dot">
131
+ <h2 class="soft-blue-custom">Other information</h2>
132
+ <div class="as">
133
+ <h3><span class="soft-blue-custom">Chat Template? </span>ChatML<span class="soft-blue-custom">, of course! Mistral V7 if you want the model smarter.</span></h3>
134
+ <h3 class="soft-blue-custom">Merge Method<h3/>
135
+ <details class="border-custom">
136
+ <summary class="soft-blue-custom">Detail YAML Config</summary>
137
+ <pre>
138
+ {
139
+ models:
140
+ - model: TroyDoesAI/BlackSheep-24B
141
+ parameters:
142
+ density: 0.9
143
+ weight: 1
144
+ - model: TheDrummer/Cydonia-24B-v2
145
+ parameters:
146
+ density: 0.6
147
+ weight: 0.8
148
+ - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
149
+ parameters:
150
+ density: 0.8
151
+ weight: 0.6
152
+ merge_method: dare_ties
153
+ base_model: TroyDoesAI/BlackSheep-24B
154
+ tokenizer_source: base
155
+ parameters:
156
+ rescale: true
157
+ dtype: bfloat16
158
+ }
159
+ </pre>
160
+ </detail>
161
+ </div>
162
+ </div>
163
+ </div>
164
+ </div>
165
+ </body>