RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation
•
16B
•
Updated
•
56.4k
•
9
RedHatAI/Qwen2-7B-Instruct-quantized.w4a16
Text Generation
•
8B
•
Updated
•
7
RedHatAI/Qwen2-72B-Instruct-quantized.w4a16
Text Generation
•
73B
•
Updated
•
882
•
4
RedHatAI/Qwen2-1.5B-Instruct-quantized.w4a16
Text Generation
•
2B
•
Updated
•
3
RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
7
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation
•
73B
•
Updated
•
3
•
1
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation
•
8B
•
Updated
•
9
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation
•
2B
•
Updated
•
1
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a16
Text Generation
•
0.5B
•
Updated
•
2
RedHatAI/Llama-2-7b-chat-quantized.w4a16
Text Generation
•
7B
•
Updated
•
25
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16
Text Generation
•
8B
•
Updated
•
66
•
2
RedHatAI/Llama-2-7b-chat-quantized.w8a16
Text Generation
•
7B
•
Updated
•
9
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a16
Text Generation
•
7B
•
Updated
•
258
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation
•
71B
•
Updated
•
83
•
6
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation
•
8B
•
Updated
•
210
•
3
RedHatAI/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
1
RedHatAI/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4
Text Generation
•
7B
•
Updated
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
71B
•
Updated
•
3
•
3
RedHatAI/Llama-2-7b-gsm8k-pruned_70
Text Generation
•
7B
•
Updated
•
2
RedHatAI/Llama-2-7b-gsm8k-pruned_50
Text Generation
•
7B
•
Updated
•
2
•
1
RedHatAI/Llama-2-7b-gsm8k
Text Generation
•
Updated
•
7
•
5
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
7B
•
Updated
•
52.6k
•
23
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
1
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_70
Updated
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70-quantized-deepsparse
Text Generation
•
Updated
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50-quantized-deepsparse
Text Generation
•
Updated
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
1
•
1
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
1
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70
Text Generation
•
7B
•
Updated
•
1
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50
Text Generation
•
7B
•
Updated
•
2