Hugging Face's logo

tensorblock
/
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF

Transformers
GGUF
deepseek
int4
vllm
llmcompressor
TensorBlock
GGUF
conversational
Model card Files
xet
 Community
morriszms commited on
Commit
d9acbea
·
verified ·
1 Parent(s): 56a291c

Keep Q2_K/Q3_K_M gguf only

Browse files
Files changed (10) hide show
  1. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_L.gguf +0 -3
  2. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_S.gguf +0 -3
  3. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_0.gguf +0 -3
  4. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_M.gguf +0 -3
  5. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_S.gguf +0 -3
  6. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_0.gguf +0 -3
  7. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_M.gguf +0 -3
  8. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_S.gguf +0 -3
  9. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q6_K.gguf +0 -3
  10. DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q8_0.gguf +0 -3
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_L.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b4757bf14ccaab68a699989b8cc156c50260cd013064a292685c5be6411704fa
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:494f885f2ddde203671f10d907fbba9c6277adf6b6dc34d4607f6472147e5ece
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:718ca94589cddd21f07ccde6678c43ca090a89be4ed767b42a38cfe3128d9394
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3bb06b333a48ceb555584b99a3f49b67a9a8d022ec9c7daecda01072ce88aa5
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee02baf7f3c65a4a0dfc48774a044d882b9f53cc22d7c75dc5b4d3bf77670cdf
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:862693029c471cab01d43b180be6c084fd0edd58323cde533c7d3388b555427b
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0e43184fcd0a0c91cd427616f7392c67807a1eb6a7cfa2f02b2c846e17ad3ba8
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:38eb35ef92a24348e27baeb2cb9f8315b581412372867114ea641ca0ee8ac85d
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q6_K.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:54ca67e4e6ee4645f17ef52d9f25eb5ca1a1cd7571726567288e6759a789f92e
3
- size 5934432
 
 
 
 
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q8_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b60e76e413b2043b702239b273905dad807d6f27562dff7a9e024297fc742591
3
- size 5934432