lucyknada commited on
Commit
dd3cb95
·
verified ·
1 Parent(s): 20e0da4

Upload ./README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Delta-Vector/Rei-V1-32B-Base
4
+ - allura-org/GLM4-32B-Neon-v2
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ ### exl3 quant
12
+ ---
13
+ ### check revisions for quants
14
+ ---
15
+
16
+ # glm-merge-0-2
17
+
18
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
+
20
+ ## Merge Details
21
+ ### Merge Method
22
+
23
+ This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
24
+
25
+ ### Models Merged
26
+
27
+ The following models were included in the merge:
28
+ * [Delta-Vector/Rei-V1-32B-Base](https://huggingface.co/Delta-Vector/Rei-V1-32B-Base)
29
+ * [allura-org/GLM4-32B-Neon-v2](https://huggingface.co/allura-org/GLM4-32B-Neon-v2)
30
+
31
+ ### Configuration
32
+
33
+ The following YAML configuration was used to produce this model:
34
+
35
+ ```yaml
36
+ models:
37
+ - model: allura-org/GLM4-32B-Neon-v2
38
+ - model: Delta-Vector/Rei-V1-32B-Base
39
+ merge_method: slerp
40
+ base_model: allura-org/GLM4-32B-Neon-v2
41
+ parameters:
42
+ t:
43
+ - value: 0.2
44
+ dtype: bfloat16
45
+ tokenizer_source: base
46
+ ```