RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation
•
14B
•
Updated
•
145
•
5
RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a16
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a16
3B
•
Updated
•
756
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a16
0.4B
•
Updated
•
1
RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a8
73B
•
Updated
RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a8
33B
•
Updated
•
45
RedHatAI/Qwen2.5-32B-quantized.w8a8
33B
•
Updated
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation
•
406B
•
Updated
•
232
•
31
RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8
3B
•
Updated
•
331
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8
2B
•
Updated
•
137
RedHatAI/SparseLlama-3-8B-pruned_50.2of4
Text Generation
•
8B
•
Updated
•
7
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic
Text Generation
•
89B
•
Updated
•
2.64k
•
11
RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Text Generation
•
4B
•
Updated
•
5
•
2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16
Text Generation
•
71B
•
Updated
•
233
•
2
RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Text Generation
•
141B
•
Updated
•
1
•
3
RedHatAI/DeepSeek-Coder-V2-Base-FP8
Text Generation
•
236B
•
Updated
•
6
RedHatAI/DeepSeek-Coder-V2-Instruct-FP8
Text Generation
•
236B
•
Updated
•
416
•
7
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
Text Generation
•
12B
•
Updated
•
9.6k
•
18
RedHatAI/Qwen2-57B-A14B-Instruct-FP8
Text Generation
•
57B
•
Updated
•
637
•
1
RedHatAI/Llama-2-7b-chat-hf-FP8
Text Generation
•
7B
•
Updated
•
143
RedHatAI/Mistral-7B-Instruct-v0.3-FP8
Text Generation
•
7B
•
Updated
•
1.74k
•
3
RedHatAI/Qwen2-0.5B-Instruct-FP8
Text Generation
•
0.5B
•
Updated
•
279
•
3
RedHatAI/Qwen2-1.5B-Instruct-FP8
Text Generation
•
2B
•
Updated
•
16k
RedHatAI/Qwen2-7B-Instruct-FP8
Text Generation
•
8B
•
Updated
•
4.97k
•
•
2
RedHatAI/Qwen2-72B-Instruct-FP8
Text Generation
•
73B
•
Updated
•
672
•
15
RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8
Text Generation
•
47B
•
Updated
•
8
•
3
RedHatAI/Meta-Llama-3-70B-Instruct-FP8
Text Generation
•
71B
•
Updated
•
670
•
•
13
RedHatAI/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
8B
•
Updated
•
2.08k
•
•
24
RedHatAI/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation
•
16B
•
Updated
•
23