concedo commited on
Commit
f9b3552
·
verified ·
1 Parent(s): a35d263

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -43
README.md CHANGED
@@ -1,43 +1,45 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # CabbageSoup-24B
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method using Broken-Tutu-24B-Unslop-v2.0 as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * Huihui-Mistral-Small-3.2-24B-Ablit-Novision
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- base_model: Broken-Tutu-24B-Unslop-v2.0
29
- dtype: float32
30
- merge_method: linear
31
- modules:
32
- default:
33
- slices:
34
- - sources:
35
- - layer_range: [0, 40]
36
- model: Broken-Tutu-24B-Unslop-v2.0
37
- parameters:
38
- weight: 0.9
39
- - layer_range: [0, 40]
40
- model: Huihui-Mistral-Small-3.2-24B-Ablit-Novision
41
- parameters:
42
- weight: 0.1
43
- ```
 
 
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # CabbageSoup-24B
10
+
11
+ This is a merge of Broken-Tutu-24B-Unslop-v2.0 and Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated created using [mergekit](https://github.com/cg123/mergekit).
12
+ It mellows out some of the biases of Broken Tutu and steers it back towards baseline Mistral Small 3.2 24B.
13
+ Note that the resultant model is still censored per se - it will require the appropriate system prompt or jailbreak in order to get unrestricted responses, similar to Broken Tutu.
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method using Broken-Tutu-24B-Unslop-v2.0 as a base.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * Huihui-Mistral-Small-3.2-24B-Ablit-Novision
24
+
25
+ ### Configuration
26
+
27
+ The following YAML configuration was used to produce this model:
28
+
29
+ ```yaml
30
+ base_model: Broken-Tutu-24B-Unslop-v2.0
31
+ dtype: float32
32
+ merge_method: linear
33
+ modules:
34
+ default:
35
+ slices:
36
+ - sources:
37
+ - layer_range: [0, 40]
38
+ model: Broken-Tutu-24B-Unslop-v2.0
39
+ parameters:
40
+ weight: 0.9
41
+ - layer_range: [0, 40]
42
+ model: Huihui-Mistral-Small-3.2-24B-Ablit-Novision
43
+ parameters:
44
+ weight: 0.1
45
+ ```