Improve language tag

#1
by lbourdois - opened
Files changed (1) hide show
  1. README.md +63 -50
README.md CHANGED
@@ -1,50 +1,63 @@
1
- ---
2
- base_model:
3
- - deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
4
- - arcee-ai/Virtuoso-Small
5
- - Krystalan/DRT-o1-14B
6
- - qingy2024/Fusion4-14B-Instruct
7
- - Qwen/Qwen2.5-14B-Instruct
8
- library_name: transformers
9
- tags:
10
- - mergekit
11
- - merge
12
-
13
- ---
14
- # WomboCombo-R1-14B-Preview
15
-
16
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
-
18
- ## Merge Details
19
- ### Merge Method
20
-
21
- This model was merged using the sce merge method using [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct) as a base.
22
-
23
- ### Models Merged
24
-
25
- The following models were included in the merge:
26
- * [deepseek-ai/DeepSeek-R1-Distill-Qwen-14B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B)
27
- * [arcee-ai/Virtuoso-Small](https://huggingface.co/arcee-ai/Virtuoso-Small)
28
- * [Krystalan/DRT-o1-14B](https://huggingface.co/Krystalan/DRT-o1-14B)
29
- * [qingy2024/Fusion4-14B-Instruct](https://huggingface.co/qingy2024/Fusion4-14B-Instruct)
30
-
31
- ### Configuration
32
-
33
- The following YAML configuration was used to produce this model:
34
-
35
- ```yaml
36
- models:
37
- # Pivot model
38
- - model: Qwen/Qwen2.5-14B-Instruct
39
- # Target models
40
- - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
41
- - model: Krystalan/DRT-o1-14B
42
- - model: arcee-ai/Virtuoso-Small
43
- - model: qingy2024/Fusion4-14B-Instruct
44
- merge_method: sce
45
- base_model: Qwen/Qwen2.5-14B-Instruct
46
- parameters:
47
- select_topk: 1.0
48
- dtype: bfloat16
49
-
50
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
4
+ - arcee-ai/Virtuoso-Small
5
+ - Krystalan/DRT-o1-14B
6
+ - qingy2024/Fusion4-14B-Instruct
7
+ - Qwen/Qwen2.5-14B-Instruct
8
+ library_name: transformers
9
+ tags:
10
+ - mergekit
11
+ - merge
12
+ language:
13
+ - zho
14
+ - eng
15
+ - fra
16
+ - spa
17
+ - por
18
+ - deu
19
+ - ita
20
+ - rus
21
+ - jpn
22
+ - kor
23
+ - vie
24
+ - tha
25
+ - ara
26
+ ---
27
+ # WomboCombo-R1-14B-Preview
28
+
29
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
30
+
31
+ ## Merge Details
32
+ ### Merge Method
33
+
34
+ This model was merged using the sce merge method using [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct) as a base.
35
+
36
+ ### Models Merged
37
+
38
+ The following models were included in the merge:
39
+ * [deepseek-ai/DeepSeek-R1-Distill-Qwen-14B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B)
40
+ * [arcee-ai/Virtuoso-Small](https://huggingface.co/arcee-ai/Virtuoso-Small)
41
+ * [Krystalan/DRT-o1-14B](https://huggingface.co/Krystalan/DRT-o1-14B)
42
+ * [qingy2024/Fusion4-14B-Instruct](https://huggingface.co/qingy2024/Fusion4-14B-Instruct)
43
+
44
+ ### Configuration
45
+
46
+ The following YAML configuration was used to produce this model:
47
+
48
+ ```yaml
49
+ models:
50
+ # Pivot model
51
+ - model: Qwen/Qwen2.5-14B-Instruct
52
+ # Target models
53
+ - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
54
+ - model: Krystalan/DRT-o1-14B
55
+ - model: arcee-ai/Virtuoso-Small
56
+ - model: qingy2024/Fusion4-14B-Instruct
57
+ merge_method: sce
58
+ base_model: Qwen/Qwen2.5-14B-Instruct
59
+ parameters:
60
+ select_topk: 1.0
61
+ dtype: bfloat16
62
+
63
+ ```