Active filters: RedHatAI
RedHatAI/gemma-2-2b-it-quantized.w4a16
Text Generation • 3B • Updated • 972
• 1
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation • 2B • Updated • 251
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation • 12B • Updated • 172
• 4
RedHatAI/gemma-2-2b-it-quantized.w8a8
Text Generation • 3B • Updated • 51
RedHatAI/gemma-2-9b-it-quantized.w8a8
Text Generation • 10B • Updated • 46
• 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • 406B • Updated • 67
• 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation • 406B • Updated • 47
• 2
RedHatAI/gemma-2-27b-it-quantized.w8a16
Text Generation • 28B • Updated • 46
RedHatAI/SmolLM-135M-Instruct-quantized.w8a16
Text Generation • 0.2B • Updated • 412
RedHatAI/SmolLM-360M-Instruct-quantized.w8a8
Text Generation • 0.4B • Updated • 58
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
Text Generation • 0.2B • Updated • 61
• 1
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 44
• 1
RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic
Text Generation • 1B • Updated • 20.7k
• 4
RedHatAI/Llama-3.2-3B-Instruct-FP8-dynamic
Text Generation • 4B • Updated • 51.4k
• 3
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 3.02k
• 8
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 1.08k
• 1
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic
Text Generation • 89B • Updated • 135
• 12
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 12.7k
• 4
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 1.82k
• 6
RedHatAI/Llama-3.2-1B-quantized.w8a8
1B • Updated • 4.02k
• 1
RedHatAI/Llama-3.2-3B-quantized.w8a8
4B • Updated • 841
RedHatAI/Llama-3.2-1B-FP8
1B • Updated • 22.6k
• 2
RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Text Generation • 4B • Updated • 61
• 2
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation • 0.6B • Updated • 123
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 1.71k
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 8.96k
• 4
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8
2B • Updated • 738
RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8
3B • Updated • 446
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 755
• 2