Hugging Face's logo

tachyphylaxis
/
DeepSeek-R1-0528-IK_GGUF

GGUF
ik_llama.cpp
conversational
Model card Files
xet
Community
tachyphylaxis Kebob commited on
Commit
08fdc6b
·
verified ·
0 Parent(s):

Duplicate from Kebob/DeepSeek-R1-0528-IK_GGUF

Browse files

Co-authored-by: Kebob <Kebob@users.noreply.huggingface.co>

Files changed (10) hide show
  1. .gitattributes +45 -0
  2. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00001-of-00008.gguf +3 -0
  3. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00002-of-00008.gguf +3 -0
  4. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00003-of-00008.gguf +3 -0
  5. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00004-of-00008.gguf +3 -0
  6. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00005-of-00008.gguf +3 -0
  7. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00006-of-00008.gguf +3 -0
  8. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00007-of-00008.gguf +3 -0
  9. IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00008-of-00008.gguf +3 -0
  10. README.md +19 -0
.gitattributes ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
37
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00001-of-00008.gguf.Kebob filter=lfs diff=lfs merge=lfs -text
38
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00001-of-00008.gguf.orig filter=lfs diff=lfs merge=lfs -text
39
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
40
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
41
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
42
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
43
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
44
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
45
+ IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1366b9d3d2b58a80ddc57ec96d2af7b6afd1a7ef92971331b986471d0b1b2d9
3
+ size 48182092256
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2695e339382d835d4d7725cefc50fbb434fac11947c712b1b85ff601b2543364
3
+ size 49347575040
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:757bb8d9b178af82cf05049c1acaaa2956e7e536ba9c95856dc8ff8a244dcfc6
3
+ size 49099818336
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c2a3269094925a4acd88f4e363cf7f7354b1690dcdd50a9d37da50b11f02381
3
+ size 49094575456
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3797bab38da9e1853f8b32b1892b58bf6e2716d4ec944d4102c0d1aded938dea
3
+ size 49347575040
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38a1afe8b0ac692420da0a378e6af608173300cda3b9ae8518c6b64875e1101d
3
+ size 49099818336
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d977c6e4e9053ae661ee0ca8faecfcddf8a4228965f90d4e2d38401222c02c3
3
+ size 48198026560
IQ4_KT/DeepSeek-R1-0528-IQ4_KT-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab86cb04be3a637b0ea13115eea171d30c4abe4350412ce146a100bb80c90cf5
3
+ size 3762348416
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model:
4
+ - deepseek-ai/DeepSeek-R1-0528
5
+ tags:
6
+ - ik_llama.cpp
7
+ ---
8
+
9
+ ## `ik_llama.cpp` quantizations of DeepSeek-R1-0528
10
+
11
+ Quantized using `ik_llama.cpp` build = 3788 (4622fadc)
12
+
13
+ NOTE: These quants **MUST** be run using the `llama.cpp` fork, [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp)
14
+
15
+ Credits to @ubergarm for his DeepSeek quant recipes for which these quants were based on.
16
+
17
+ | name | file size | quant type | bpw |
18
+ | --- | --- | --- | --- |
19
+ | DeepSeek-R1-0528-IQ4_KT | 322.355 GiB | `IQ4_KT` (97.5%) / `Q8_0` (2.5%) | 4.127 |