Inference Providers
Active filters: fp8
haoyang-amd/deepseek-moe-16b-chat-fp8-perchannel
3B • Updated • 4
Text Generation
• 685B • Updated • 5
jobs-git/DeepSeek-V3-base
685B • Updated • 1
Text Generation
• 685B • Updated • 3
BuckalewFinancial/DeepSeek-R1
Text Generation
• Updated • 6
• 1
Text Generation
• Updated • 6
• 2
thisnick/Llama-3.1-8B-Instruct-abliterated-FP8-Dynamic
8B • Updated • 4
FlorianJc/DeepSeek-R1-Distill-Llama-8B-vllm-fp8
Text Generation
• 8B • Updated • 10
8B • Updated • 1
1B • Updated • 4
33B • Updated • 1
2B • Updated • 1
pranavthombare/Llama-3.3-70B-Instruct-FP8
71B • Updated • 3
8B • Updated • 1
thisnick/Llama-3.3-70B-Instruct-abliterated-FP8-Dynamic
71B • Updated • 134
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic
Text Generation
• 24B • Updated • 1.77k
• 13
rohithsiddhartha/DeepSeek-V3-4bit
nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
• 71B • Updated • 29
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
• 2B • Updated • 486
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
• 8B • Updated • 1.46k
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
• 15B • Updated • 371
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
• 33B • Updated • 5.66k
• 10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
• 8B • Updated • 468
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
• 71B • Updated • 6.29k
• 10
Text Generation
• 685B • Updated • 5
luccafong/deepseek_mtp_main_random
6B • Updated • 96.9k
luccafong/deepseek_mtp_draft_random
11B • Updated • 29.6k
4B • Updated • 4
medmekk/mini-deepseek-r1-4layers
15B • Updated • 3