BitsAndBytes 4 bits quantization from DeepSeek-R1-Distill-Qwen-14B commit 123265213609ea67934b1790bbb0203d3c50f54f

Safetensors

Model size

15B params

Tensor type

F16

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for MPWARE/DeepSeek-R1-Distill-Qwen-14B-BnB-4bits

Base model

Quantized

(131)

this model

Collection including MPWARE/DeepSeek-R1-Distill-Qwen-14B-BnB-4bits