Inference Providers
Active filters: fp8
TevunahAi/granite-34b-code-instruct-8k-FP8
Text Generation
• 34B • Updated • 4
TevunahAi/Qwen3-Next-80B-A3B-Instruct-FP8
Text Generation
• 80B • Updated • 10
vlnkane/DeepSeek-V3-4Layer
15B • Updated • 5
unsloth/Qwen3-VL-2B-Instruct-FP8
Image-Text-to-Text
• 2B • Updated • 89
KJML/typhoon2.5-qwen3-30b-a3b-FP8-Dynamic
Text Generation
• 31B • Updated • 109
unsloth/Qwen3-VL-32B-Instruct-FP8
Image-Text-to-Text
• 33B • Updated • 11
• 1
unsloth/Qwen3-VL-32B-Thinking-FP8
Image-Text-to-Text
• 33B • Updated • 5
• 2
unsloth/Qwen3-VL-235B-A22B-Thinking-FP8
Image-Text-to-Text
• 236B • Updated • 2
unsloth/Qwen3-VL-235B-A22B-Instruct-FP8
Image-Text-to-Text
• 236B • Updated • 7
TevunahAi/Apertus-8B-Instruct-2509-FP8
Text Generation
• 8B • Updated • 3
FlagRelease/MiniMax-M2-FlagOS
229B • Updated • 7
• 1
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
TevunahAi/Apertus-70B-Instruct-2509-2048-Calibration-FP8
Text Generation
• 71B • Updated • 3
TevunahAi/gpt-oss-20b-2048-Calibration-FP8
Text Generation
• 21B • Updated • 11
• 1
TevunahAi/gpt-oss-120b-1024-Calibration-FP8
Text Generation
• 117B • Updated • 28
• 2
deepseek-ai/DeepSeek-Math-V2
Text Generation
• 685B • Updated • 481
• 704
jiangchengchengNLP/qwen3-4b-fp8-scaled
Updated • 54
• 30
TevunahAi/NextCoder-7B-2048-Calibration-FP8
Text Generation
• 8B • Updated • 6
• 1