win10 commited on
Commit
5fdc19a
·
verified ·
1 Parent(s): c493292

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -63
README.md CHANGED
@@ -1,63 +1,22 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # oss-plus-v4
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the Passthrough merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * ./gpt-oss-20b-BF16
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- slices:
29
- # 底層編碼 (0-8)
30
- - sources:
31
- - layer_range: [0, 8]
32
- model: ./gpt-oss-20b-BF16
33
-
34
- # 分析推理核心區 (12-20) - 2層重疊
35
- - sources:
36
- - layer_range: [7, 12]
37
- model: ./gpt-oss-20b-BF16
38
-
39
- # 深度推理區 (18-26) - 2層重疊
40
- - sources:
41
- - layer_range: [9, 17]
42
- model: ./gpt-oss-20b-BF16
43
-
44
- - sources:
45
- - layer_range: [12, 18]
46
- model: ./gpt-oss-20b-BF16
47
-
48
- - sources:
49
- - layer_range: [17, 19]
50
- model: ./gpt-oss-20b-BF16
51
-
52
- - sources:
53
- - layer_range: [18, 22]
54
- model: ./gpt-oss-20b-BF16
55
-
56
- - sources:
57
- - layer_range: [21, 24]
58
- model: ./gpt-oss-20b-BF16
59
-
60
- include_non_layer_weights: true
61
- merge_method: passthrough
62
- dtype: bfloat16
63
- ```
 
1
+ ---
2
+ base_model:
3
+ - unsloth/gpt-oss-20b-BF16
4
+ license: apache-2.0
5
+ pipeline_tag: text-generation
6
+ library_name: transformers
7
+ tags:
8
+ - vllm
9
+ - unsloth
10
+
11
+ - mergekit
12
+ - gpt_oss
13
+ ---
14
+ # win10/GPT-OSS-30B-Preview
15
+
16
+ This is an expanded version of [unsloth/gpt-oss-20b-BF16](https://huggingface.co/unsloth/gpt-oss-20b-BF16) scaled up to 26B parameters
17
+
18
+ ### Donation
19
+ ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.
20
+
21
+ - **PayPal**: [Support via PayPal](https://www.paypal.com/ncp/payment/EZZ3DDRMBBFBG)
22
+ - **Ko-fi**: [Support our work on Ko-fi](https://ko-fi.com/ogodwin10)