RedHatAI/gemma-2-2b-it-quantized.w4a16
Text Generation
• 1B • Updated • 29
• 1
RedHatAI/gemma-2-9b-it-quantized.w4a16
Text Generation
• 3B • Updated • 16
• 2
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation
• 3B • Updated • 14
RedHatAI/gemma-2-2b-quantized.w8a16
Text Generation
• 2B • Updated RedHatAI/gemma-2-2b-it-quantized.w8a16
Text Generation
• 2B • Updated • 3
• 1
RedHatAI/gemma-2-9b-it-quantized.w8a16
Text Generation
• 4B • Updated • 41
• 1
RedHatAI/gemma-2-2b-it-FP8
3B • Updated • 84
• 1
RedHatAI/starcoder2-15b-quantized.w8a8
Text Generation
• 16B • Updated • 5
RedHatAI/starcoder2-7b-quantized.w8a8
Text Generation
• 7B • Updated • 11
RedHatAI/starcoder2-3b-quantized.w8a8
Text Generation
• 3B • Updated • 11
RedHatAI/starcoder2-7b-quantized.w8a16
Text Generation
• 2B • Updated • 5
RedHatAI/starcoder2-3b-quantized.w8a16
Text Generation
• 1B • Updated • 6
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation
• 71B • Updated • 3
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation
• 410B • Updated • 16
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation
• 19B • Updated RedHatAI/starcoder2-3b-FP8
Text Generation
• 3B • Updated • 4
RedHatAI/starcoder2-7b-FP8
Text Generation
• 7B • Updated • 1
RedHatAI/starcoder2-15b-FP8
Text Generation
• 16B • Updated • 6.34k
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16
Text Generation
• 4B • Updated • 4
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation
• 3B • Updated • 6
• 1
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation
• 71B • Updated • 93
• 2
RedHatAI/Mistral-Large-Instruct-2407-FP8
Text Generation
• 123B • Updated • 99
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation
• 19B • Updated • 260
• 5
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
• 8B • Updated • 496k
• 44
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8
Text Generation
• 7B • Updated • 17
• 2
RedHatAI/Qwen2-72B-Instruct-quantized.w8a8
Text Generation
• 73B • Updated • 5
• 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation
• 71B • Updated • 103
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation
• 8B • Updated • 158
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16
Text Generation
• 2B • Updated • 1.21k
• 3
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8
Text Generation
• 0.6B • Updated • 11