beyoru commited on
Commit
aa48de2
·
verified ·
1 Parent(s): 39bf5ff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -39
README.md CHANGED
@@ -8,42 +8,3 @@ tags:
8
  - merge
9
 
10
  ---
11
- # merged_model
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B)
24
- * [suayptalha/Qwen3-0.6B-Code-Expert](https://huggingface.co/suayptalha/Qwen3-0.6B-Code-Expert)
25
-
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
-
32
- slices:
33
- - sources:
34
- - model: Qwen/Qwen3-0.6B
35
- layer_range: [0, 28]
36
- - model: suayptalha/Qwen3-0.6B-Code-Expert
37
- layer_range: [0, 28]
38
- merge_method: slerp
39
- base_model: Qwen/Qwen3-0.6B
40
- parameters:
41
- t:
42
- - filter: self_attn
43
- value: [0, 0.5, 0.3, 0.7, 1]
44
- - filter: mlp
45
- value: [1, 0.5, 0.7, 0.3, 0]
46
- - value: 0.5
47
- dtype: bfloat16
48
-
49
- ```
 
8
  - merge
9
 
10
  ---