Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,655

Base only

Active filters: fp8

jsaon123/Qwen3-Coder-Next-FP8

Text Generation • 80B • Updated Mar 2 • 9

lovedheart/Qwen3.5-9B-FP8

Image-Text-to-Text • 10B • Updated Mar 2 • 57.5k • 14

lovedheart/Qwen3.5-4B-FP8

Image-Text-to-Text • 5B • Updated Mar 3 • 33.5k • 6

Ksenia700/Kimi-K2-Instruct-0905

Text Generation • 1T • Updated Mar 2 • 2

RoyMDT/DeepSeek-R1

Text Generation • 685B • Updated Mar 3 • 3

hugg1ngfac3/deepseek-r1-tiny

3B • Updated Mar 3 • 125

RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic

Image-Text-to-Text • 123B • Updated Apr 28 • 1.63k • 1

zimingz820/DeepSeek-R1

Text Generation • 685B • Updated Mar 3 • 4

Alexzander85/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4-MLP-FP8KV

Text Generation • 8B • Updated Mar 4 • 279 • 9

zsjTiger/MiniMax-M2.5

Text Generation • 229B • Updated Mar 5 • 4

MurphyA/DeepSeek-R1

Text Generation • 685B • Updated Mar 5 • 3

MurphyA/MiniMax-M2.5

Text Generation • 229B • Updated Mar 5 • 3

CPU-Hybrid-MoE/MiniMax-M2.5-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 5 • 3

Vajra211/MiniMax-M2.5

Text Generation • 229B • Updated Mar 5 • 5

cly124567/GLM-5-FP8

Text Generation • 754B • Updated Mar 5 • 2

Panda-Smile/MiniMax-M2.5

Text Generation • 229B • Updated Mar 6 • 7

np-deploys/Qwen3-VL-30B-A3B-Instruct-FP8

Image-Text-to-Text • 31B • Updated Mar 6 • 6

ikarius/Phi-4-Abliterated-FineGrained-FP8

Text Generation • 15B • Updated Mar 7 • 4

apothic/Qwen3.5-9B-ultra-heretic-fp8

Image-Text-to-Text • 9B • Updated Mar 6 • 15 • 4

Heouzen/Huihui-Qwen3-VL-32B-Instruct-FP8-abliterated

Image-Text-to-Text • 33B • Updated Mar 7 • 1.36k

RedHatAI/Qwen3.5-35B-A3B-FP8-dynamic

Image-Text-to-Text • 35B • Updated Apr 28 • 2.53k • 9

zswll2/Qwen3.5-9B-Claude-4.6-HighIQ-THINKING-HERETIC-UNCENSORED-fp8-sglang

9B • Updated Mar 8 • 18 • 1

edp1096/Huihui-Qwen3.5-27B-abliterated-FP8

Image-Text-to-Text • 28B • Updated Mar 8 • 19

inference-optimization/sarvam-30b-FP8-Dynamic

Text Generation • 32B • Updated Mar 9 • 12 • 1

inference-optimization/sarvam-105b-FP8-Dynamic

Text Generation • 106B • Updated Mar 9 • 6

m-hasnain-sabqi/MiniMax-M2.5

Text Generation • 229B • Updated Mar 9 • 5

safestack/Ministral-3-8B-Instruct-2512

9B • Updated Jan 15 • 4

bxintsa/DeepSeek-V3.2-Exp

Text Generation • 685B • Updated Mar 9 • 8

pathcosmos/frankenstallm

Text Generation • 3B • Updated Mar 26 • 398

RedHatAI/sarvam-30b-FP8-dynamic

Text Generation • 32B • Updated Apr 28 • 29.6k • 1