gss1147 commited on
Commit
63d00f7
·
verified ·
1 Parent(s): 64f79e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -54
README.md CHANGED
@@ -1,54 +1,55 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # WithinUs_CPU_Hybrid
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * X:/Genesis_X/models/openfree-Darwin-Qwen3-4B
22
- * X:/Genesis_X/models/Lucidity-AI-Astral-4B-Coder
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- base_model: X:/Genesis_X/models/Lucidity-AI-Astral-4B-Coder
30
- dtype: float16
31
- merge_method: slerp
32
- parameters:
33
- t:
34
- - filter: embed_tokens
35
- value: 0.0
36
- - filter: self_attn
37
- value: 0.5
38
- - filter: mlp
39
- value: 0.5
40
- - filter: lm_head
41
- value: 1.0
42
- - value: 0.5
43
- slices:
44
- - sources:
45
- - layer_range:
46
- - 0
47
- - 36
48
- model: X:/Genesis_X/models/Lucidity-AI-Astral-4B-Coder
49
- - layer_range:
50
- - 0
51
- - 36
52
- model: X:/Genesis_X/models/openfree-Darwin-Qwen3-4B
53
-
54
- ```
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen3-4B-Instruct-2507
4
+ library_name: transformers
5
+ tags:
6
+ - mergekit
7
+ - merge
8
+ ---
9
+ # WithinUs_CPU_Hybrid
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * openfree-Darwin-Qwen3-4B
22
+ * Lucidity-AI-Astral-4B-Coder
23
+
24
+
25
+ ### Configuration
26
+
27
+ The following YAML configuration was used to produce this model:
28
+
29
+ ```yaml
30
+ base_model:Qwen/Qwen3-4B-Instruct-2507
31
+ dtype: float16
32
+ merge_method: slerp
33
+ parameters:
34
+ t:
35
+ - filter: embed_tokens
36
+ value: 0.0
37
+ - filter: self_attn
38
+ value: 0.5
39
+ - filter: mlp
40
+ value: 0.5
41
+ - filter: lm_head
42
+ value: 1.0
43
+ - value: 0.5
44
+ slices:
45
+ - sources:
46
+ - layer_range:
47
+ - 0
48
+ - 36
49
+ model: Lucidity-AI-Astral-4B-Coder
50
+ - layer_range:
51
+ - 0
52
+ - 36
53
+ model: openfree-Darwin-Qwen3-4B
54
+
55
+ ```