Improve language tag

#2
by lbourdois - opened
Files changed (1) hide show
  1. README.md +63 -50
README.md CHANGED
@@ -1,50 +1,63 @@
1
- ---
2
- base_model:
3
- - Qwen/Qwen2.5-1.5B
4
- - Qwen/Qwen2.5-1.5B-Instruct
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
-
10
- ---
11
- # my-output
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the SLERP merge method.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [Qwen/Qwen2.5-1.5B](https://huggingface.co/Qwen/Qwen2.5-1.5B)
24
- * [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct)
25
-
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
-
32
- slices:
33
- - sources:
34
- - model: Qwen/Qwen2.5-1.5B
35
- layer_range: [0, 28]
36
- - model: Qwen/Qwen2.5-1.5B-Instruct
37
- layer_range: [0, 28]
38
- merge_method: slerp
39
- base_model: Qwen/Qwen2.5-1.5B-Instruct
40
- parameters:
41
- t:
42
- - filter: self_attn
43
- value: [0, 0.25, 0.5, 0.75, 1]
44
- - filter: mlp
45
- value: [1, 0.75, 0.5, 0.25, 0]
46
- - value: 0.5
47
- dtype: bfloat16
48
-
49
-
50
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-1.5B
4
+ - Qwen/Qwen2.5-1.5B-Instruct
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ language:
10
+ - zho
11
+ - eng
12
+ - fra
13
+ - spa
14
+ - por
15
+ - deu
16
+ - ita
17
+ - rus
18
+ - jpn
19
+ - kor
20
+ - vie
21
+ - tha
22
+ - ara
23
+ ---
24
+ # my-output
25
+
26
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
27
+
28
+ ## Merge Details
29
+ ### Merge Method
30
+
31
+ This model was merged using the SLERP merge method.
32
+
33
+ ### Models Merged
34
+
35
+ The following models were included in the merge:
36
+ * [Qwen/Qwen2.5-1.5B](https://huggingface.co/Qwen/Qwen2.5-1.5B)
37
+ * [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct)
38
+
39
+ ### Configuration
40
+
41
+ The following YAML configuration was used to produce this model:
42
+
43
+ ```yaml
44
+
45
+ slices:
46
+ - sources:
47
+ - model: Qwen/Qwen2.5-1.5B
48
+ layer_range: [0, 28]
49
+ - model: Qwen/Qwen2.5-1.5B-Instruct
50
+ layer_range: [0, 28]
51
+ merge_method: slerp
52
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
53
+ parameters:
54
+ t:
55
+ - filter: self_attn
56
+ value: [0, 0.25, 0.5, 0.75, 1]
57
+ - filter: mlp
58
+ value: [1, 0.75, 0.5, 0.25, 0]
59
+ - value: 0.5
60
+ dtype: bfloat16
61
+
62
+
63
+ ```