lucyknada commited on
Commit
290d0e6
·
verified ·
1 Parent(s): 5efbec1

Upload ./README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Sao10K/32B-Qwen2.5-Kunou-v1
4
+ - Delta-Vector/Hamanasu-Magnum-QwQ-32B
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ ### exl2 quant (measurement.json in main branch)
12
+ ---
13
+ ### check revisions for quants
14
+ ---
15
+
16
+ # merge
17
+
18
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
+
20
+ ## Merge Details
21
+ ### Merge Method
22
+
23
+ This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
24
+
25
+ ### Models Merged
26
+
27
+ The following models were included in the merge:
28
+ * [Sao10K/32B-Qwen2.5-Kunou-v1](https://huggingface.co/Sao10K/32B-Qwen2.5-Kunou-v1)
29
+ * [Delta-Vector/Hamanasu-Magnum-QwQ-32B](https://huggingface.co/Delta-Vector/Hamanasu-Magnum-QwQ-32B)
30
+
31
+ ### Configuration
32
+
33
+ The following YAML configuration was used to produce this model:
34
+
35
+ ```yaml
36
+ models:
37
+ - model: Sao10K/32B-Qwen2.5-Kunou-v1
38
+ - model: Delta-Vector/Hamanasu-Magnum-QwQ-32B
39
+ merge_method: slerp
40
+ base_model: Delta-Vector/Hamanasu-Magnum-QwQ-32B
41
+ parameters:
42
+ t:
43
+ - value: 0.2
44
+ dtype: bfloat16
45
+ tokenizer_source: base
46
+
47
+ ```