RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16
Text Generation
• 4B • Updated • 289
• 1
RedHatAI/Llama-3.1-8B-Instruct-FP8-block
Text Generation
• 8B • Updated • 38
RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-block
Text Generation
• 236B • Updated • 9
• 3
RedHatAI/Qwen3-30B-A3B-FP8-block
Text Generation
• 31B • Updated • 15.4k
RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-block
Text Generation
• 109B • Updated • 4
• 3
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8-block
Text Generation
• 402B • Updated • 6
• 1
RedHatAI/Llama-3.3-70B-Instruct-FP8-block
Text Generation
• 71B • Updated • 10.7k
RedHatAI/Qwen3-32B-FP8-block
Text Generation
• 33B • Updated • 7
RedHatAI/Qwen3-14B-FP8-block
Text Generation
• 15B • Updated • 40
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic
Text Generation
• 71B • Updated • 8.34k
• 14
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF
Text Generation
• 71B • Updated • 2
• 2
RedHatAI/Llama-3.2-1B-FP8
1B • Updated • 40.8k
Image-Text-to-Text
• 12B • Updated • 163
• 1
RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-dynamic
Text Generation
• 236B • Updated • 141
• 4
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8
Image-Text-to-Text
• 8B • Updated • 46k
• 9
RedHatAI/Apertus-70B-Instruct-2509-FP8-dynamic
Text Generation
• 71B • Updated • 45
• 1
RedHatAI/phi-4-FP8-dynamic
Text Generation
• 15B • Updated • 4.28k
• 1
RedHatAI/phi-4-quantized.w8a8
Text Generation
• 15B • Updated • 484
• 3
Text Generation
• 15B • Updated • 170
• 1
RedHatAI/phi-4-quantized.w4a16
Text Generation
• 3B • Updated • 241
• 5
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
• 8B • Updated • 136
• 2
RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16
Text Generation
• 11B • Updated • 154
• 1
RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation
• 15B • Updated • 296
• 1
Text Generation
• 9B • Updated • 4
• 1
RedHatAI/gemma-2-9b-it-FP8
Text Generation
• 9B • Updated • 436
• 5
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
• 8B • Updated • 18.1k
• 20
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation
• 1B • Updated • 14
• 1
RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16
Text Generation
• 2B • Updated • 146
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
Text Generation
• 8B • Updated • 356
• 2
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
• 1B • Updated • 750
• 1