Hugging Face's logo

nold
/
Prima-Pastacles-7b-GGUF

Transformers
GGUF
mergekit
Merge
Model card Files
xet
 Community
3

Upload folder using huggingface_hub

#2
by nold - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+14
-14
Files changed (7) hide show
  1. .gitattributes +1 -0
  2. Prima-Pastacles-7b_Q2_K.gguf +1 -1
  3. Prima-Pastacles-7b_Q4_K_M.gguf +1 -1
  4. Prima-Pastacles-7b_Q5_K_M.gguf +1 -1
  5. Prima-Pastacles-7b_Q6_K.gguf +3 -0
  6. Prima-Pastacles-7b_Q8_0.gguf +1 -1
  7. README.md +6 -10
.gitattributes CHANGED
@@ -37,3 +37,4 @@ Prima-Pastacles-7b_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Prima-Pastacles-7b_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
  Prima-Pastacles-7b_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Prima-Pastacles-7b_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
37
  Prima-Pastacles-7b_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
  Prima-Pastacles-7b_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Prima-Pastacles-7b_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Prima-Pastacles-7b_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Prima-Pastacles-7b_Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a89296afa5c65d99b3291dfda38497f52deb3ca1fa9ad313f93207c78823af35
3
  size 2719241856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a135305bbc41153b01bdeba36ba9940a68ab23806802aadf11ddc1136df57f66
3
  size 2719241856
Prima-Pastacles-7b_Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a421d9932e4501627632c1e71e42848decc42ada5778d7d88a3b4037e02ef80a
3
  size 4368438912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d0ce480c5171372494318d5dd071158f84d9ce926bf19f13546b6fe122a218a
3
  size 4368438912
Prima-Pastacles-7b_Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d85c1cad2aad50da3c5ee3d7417d36651121f25fe017de83eb2c0077755e637
3
  size 5131409024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6e2225d5767403c7f7776c84dfc58f97ae75fa900887bc3c86d8d872de7752e
3
  size 5131409024
Prima-Pastacles-7b_Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e34bb7d35748b40a06042983542570650777ded04e8ba5079a5902f325dbbe4a
3
+ size 5942064768
Prima-Pastacles-7b_Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93bdb6d097f55c0fb61aec390656c0355ce293e5b7a09489350b59bf41af8acb
3
  size 7695857280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef6b6c60ef474a907eda4df1171bc56e06ad28853d33fb248a17307a0251ecf3
3
  size 7695857280
README.md CHANGED
@@ -8,17 +8,12 @@ tags:
8
  - merge
9
 
10
  ---
11
- # mergedmodel
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the SLERP merge method.
19
-
20
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Gs09MsXrzyJdDx7IrnkDa.jpeg)
 
 
 
21
 
 
22
  ### Models Merged
23
 
24
  The following models were included in the merge:
@@ -51,4 +46,5 @@ dtype: bfloat16
51
 
52
  ***
53
 
54
- Vanilla Quantization by [nold](https://huggingface.co/nold), Original Model [Test157t/Prima-Pastacles-7b](https://huggingface.co/Test157t/Prima-Pastacles-7b). Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline - 0e95dcd401087b713c2eca7c89ff8108e61969f0
 
 
8
  - merge
9
 
10
  ---
 
 
 
 
 
 
 
 
 
11
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Gs09MsXrzyJdDx7IrnkDa.jpeg)
12
+ Quants Thanks to @Nold and @Bartowski:
13
+
14
+ https://huggingface.co/nold/Prima-Pastacles-7b-GGUF
15
 
16
+ https://huggingface.co/bartowski/Prima-Pastacles-7b-exl2
17
  ### Models Merged
18
 
19
  The following models were included in the merge:
 
46
 
47
  ***
48
 
49
+ Quantization of Model [Test157t/Prima-Pastacles-7b](https://huggingface.co/Test157t/Prima-Pastacles-7b).
50
+ Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline