neuralmagic 's Collections DeepSeek-R1-Distill Quantized
updated
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
• Updated
• 1.97k
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
• 71B • Updated
• 20.1k
• 10
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
• 33B • Updated
• 4.41k
• 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
• 71B • Updated
• 322
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
• Updated
• 2.13k
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
• 8B • Updated
• 1.98k
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
• 2B • Updated
• 6.95k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
• 2B • Updated
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
• 15B • Updated
• 3.02k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
• 8B • Updated
• 5.84k
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
• 2B • Updated
• 2.14k
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
• 8B • Updated
• 4.69k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
• 3B • Updated
• 2k
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
• 2B • Updated
• 3.57k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
• 0.6B • Updated
• 141
• 1
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
• 11B • Updated
• 12.7k
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
• 6B • Updated
• 1.16k
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
• Updated
• 125
• 13