Active filters: RedHatAI
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_50.2of4
Text Generation • 7B • Updated • 16
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation • 7B • Updated • 276
• 25
RedHatAI/Meta-Llama-3-70B-Instruct-FP8
Text Generation • 71B • Updated • 589
• 13
RedHatAI/Qwen2-72B-Instruct-FP8
Text Generation • 73B • Updated • 1.08k
• 16
RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Text Generation • 141B • Updated • 36
• 3
RedHatAI/Qwen2-0.5B-Instruct-FP8
Text Generation • 0.5B • Updated • 3.52k
• 3
RedHatAI/Qwen2-1.5B-Instruct-FP8
Text Generation • 2B • Updated • 805
RedHatAI/Qwen2-7B-Instruct-FP8
Text Generation • 8B • Updated • 324
• 2
RedHatAI/SparseLlama-3-8B-pruned_50.2of4
Text Generation • 8B • Updated • 24
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation • 71B • Updated • 34
• 3
RedHatAI/Mistral-7B-Instruct-v0.3-FP8
Text Generation • 7B • Updated • 606
• 3
RedHatAI/Llama-2-7b-chat-hf-FP8
Text Generation • 7B • Updated • 59
RedHatAI/Phi-3-mini-128k-instruct-FP8
Text Generation • 4B • Updated • 169
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 58
• 5
RedHatAI/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4
Text Generation • 7B • Updated • 15
RedHatAI/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4
Text Generation • 7B • Updated • 12
RedHatAI/Llama-2-7b-chat-quantized.w8a16
Text Generation • 7B • Updated • 57
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 154
• 3
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation • 71B • Updated • 22
• 6
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a16
Text Generation • 0.5B • Updated • 70
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation • 2B • Updated • 62
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 58
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation • 73B • Updated • 22
• 1
RedHatAI/gemma-2-9b-it-FP8
Text Generation • 9B • Updated • 821
• 5
RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation • 0.6B • Updated • 77
RedHatAI/Qwen2-1.5B-Instruct-quantized.w4a16
Text Generation • 2B • Updated • 60
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a16
Text Generation • 7B • Updated • 94
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16
Text Generation • 4B • Updated • 41
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16
Text Generation • 14B • Updated • 46
• 2
RedHatAI/Llama-2-7b-chat-quantized.w8a8
Text Generation • 7B • Updated • 47
• 1