Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
tensorblock
/
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
like
0
Follow
TensorBlock
281
Transformers
GGUF
deepseek
int4
vllm
llmcompressor
TensorBlock
GGUF
conversational
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
71.2 MB
1 contributor
History:
5 commits
morriszms
Update README.md
56a291c
verified
6 months ago
.gitattributes
Safe
2.61 kB
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q2_K.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_L.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_M.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_S.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_0.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_M.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_S.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_0.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_M.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_S.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q6_K.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q8_0.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
10 months ago
README.md
Safe
7.75 kB
Update README.md
6 months ago
