nold commited on
Commit
00fced8
·
verified ·
1 Parent(s): d983809

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Prima-Pastacles-7b_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Prima-Pastacles-7b_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Prima-Pastacles-7b_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Prima-Pastacles-7b_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Prima-Pastacles-7b_Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a89296afa5c65d99b3291dfda38497f52deb3ca1fa9ad313f93207c78823af35
3
+ size 2719241856
Prima-Pastacles-7b_Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a421d9932e4501627632c1e71e42848decc42ada5778d7d88a3b4037e02ef80a
3
+ size 4368438912
Prima-Pastacles-7b_Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d85c1cad2aad50da3c5ee3d7417d36651121f25fe017de83eb2c0077755e637
3
+ size 5131409024
Prima-Pastacles-7b_Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93bdb6d097f55c0fb61aec390656c0355ce293e5b7a09489350b59bf41af8acb
3
+ size 7695857280
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Locutusque/Hercules-2.5-Mistral-7B
4
+ - Test157t/Pasta-PrimaMaid-7b
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # mergedmodel
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the SLERP merge method.
19
+
20
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Gs09MsXrzyJdDx7IrnkDa.jpeg)
21
+
22
+ ### Models Merged
23
+
24
+ The following models were included in the merge:
25
+ * [Locutusque/Hercules-2.5-Mistral-7B](https://huggingface.co/Locutusque/Hercules-2.5-Mistral-7B)
26
+ * [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b)
27
+
28
+ ### Configuration
29
+
30
+ The following YAML configuration was used to produce this model:
31
+
32
+ ```yaml
33
+ slices:
34
+ - sources:
35
+ - model: Test157t/Pasta-PrimaMaid-7b
36
+ layer_range: [0, 32]
37
+ - model: Locutusque/Hercules-2.5-Mistral-7B
38
+ layer_range: [0, 32]
39
+ merge_method: slerp
40
+ base_model: Test157t/Pasta-PrimaMaid-7b
41
+ parameters:
42
+ t:
43
+ - filter: self_attn
44
+ value: [0, 0.5, 0.3, 0.7, 1]
45
+ - filter: mlp
46
+ value: [1, 0.5, 0.7, 0.3, 0]
47
+ - value: 0.5
48
+ dtype: bfloat16
49
+ ```
50
+
51
+
52
+ ***
53
+
54
+ Vanilla Quantization by [nold](https://huggingface.co/nold), Original Model [Test157t/Prima-Pastacles-7b](https://huggingface.co/Test157t/Prima-Pastacles-7b). Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline - 0e95dcd401087b713c2eca7c89ff8108e61969f0