RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w4a16 Text Generation • 7B • Updated Mar 13, 2025 • 134 • 2
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16 Text Generation • 0.5B • Updated Feb 28, 2025 • 80.9k
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16 Text Generation • 2B • Updated Feb 27, 2025 • 161 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8 Text Generation • 2B • Updated Feb 27, 2025 • 1.47k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16 Text Generation • 8B • Updated Feb 27, 2025 • 132 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 1.06k • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 390 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16 Text Generation • 15B • Updated Feb 27, 2025 • 345 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8 Text Generation • 15B • Updated Feb 27, 2025 • 1.14k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic Text Generation • 15B • Updated Feb 27, 2025 • 297 • 3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16 Text Generation • 33B • Updated Feb 27, 2025 • 513 • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8 Text Generation • 33B • Updated Feb 27, 2025 • 3.2k • 13
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic Text Generation • 33B • Updated Feb 27, 2025 • 7.47k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 Text Generation • 71B • Updated Feb 27, 2025 • 1.16k • 6
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 Text Generation • 71B • Updated Feb 27, 2025 • 212 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic Text Generation • 71B • Updated Feb 27, 2025 • 14.5k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16 Text Generation • 8B • Updated Feb 27, 2025 • 495
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 1.18k • 2
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 266 • 5