Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
tensorblock
/
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
like
0
Follow
TensorBlock
310
Transformers
GGUF
deepseek
int4
vllm
llmcompressor
TensorBlock
GGUF
conversational
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
f8bc256
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
71.2 MB
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
morriszms
Update README.md
f8bc256
verified
about 1 year ago
.gitattributes
Safe
2.61 kB
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q2_K.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_L.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_M.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_S.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_0.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_M.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_S.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_0.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_M.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_S.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q6_K.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q8_0.gguf
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
README.md
6.87 kB
Update README.md
about 1 year ago