Hugging Face's logo

unsloth
/
DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation
Transformers
GGUF
English
llama
deepseek
unsloth
llama-3
meta
imatrix
conversational
Model card Files
xet
 Community
2
danielhanchen commited on
Commit
890e183
·
verified ·
1 Parent(s): fd59c40

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +3 -0
  2. DeepSeek-R1-Distill-Llama-70B-Q2_K.gguf +2 -2
  3. DeepSeek-R1-Distill-Llama-70B-Q3_K_M.gguf +2 -2
  4. DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf +2 -2
  5. DeepSeek-R1-Distill-Llama-70B-Q5_K_M.gguf +2 -2
  6. DeepSeek-R1-Distill-Llama-70B-UD-IQ2_XXS.gguf +3 -0
  7. Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00002.gguf +3 -0
  8. Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -52,3 +52,6 @@ DeepSeek-R1-Distill-Llama-70B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -tex
52
  DeepSeek-R1-Distill-Llama-70B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
53
  DeepSeek-R1-Distill-Llama-70B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
54
  DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
52
  DeepSeek-R1-Distill-Llama-70B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
53
  DeepSeek-R1-Distill-Llama-70B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
54
  DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
55
+ DeepSeek-R1-Distill-Llama-70B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Llama-70B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ea8bf57266576a30b9e2f3f5d1f50ad22daf547aa0e3a8ede7433b28b3a1ccc
3
- size 26375111104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dda514411c5cbc72d4d6664a55a0a415bb5899e52973ad1babbedd759757d359
3
+ size 26375111328
DeepSeek-R1-Distill-Llama-70B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61ed3f9e10925faa36f64996b41bfc0ee9da5f5002b63459d3f918e155fbed88
3
- size 34267496896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f679319027d6c6cf934e01e12a0e384e022fc8d04dc2ad5fda748d71b4b1f3a
3
+ size 34267497120
DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4e213bae69ce15086cad563ad05d6593072ba56c7278cf9a3cb15980f8590ce
3
- size 42520396224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:952ff479c48ac3ece81fb6d9a5a03bfeac215e6caac780fbe91ff8cb0e05bcf3
3
+ size 42520396448
DeepSeek-R1-Distill-Llama-70B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a00fbf315d62aa46a2d703907e613829bcac4fbe1dbf3829bbfc947d494c0f1
3
- size 49949819328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:291ed415b22272a873557f377d598f87fea54835adf5a5395be39461aeea4224
3
+ size 49949819552
DeepSeek-R1-Distill-Llama-70B-UD-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30e19a898bdc5321adec72aa92568a769e9eb03684c37601b82a3a0943fe0f78
3
+ size 19447628448
Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2cfd0dbfaf32a9a3d864d83e29f0281ab62750f34512bcbbaf6dccce33dd6e6
3
+ size 49973947296
Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9721422ec6ea86d1734d7cc28681f46b4df6fda3f6c325e6351919e8a8333d89
3
+ size 7914199008