Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,646

Base only

Active filters: fp8

Civitai/Huihui-Qwen3.6-27B-abliterated-FP8

28B • Updated Jun 2 • 135

rdtand/Gemma4-31B-IT-PrismaQuant-6bit-vllm

Text Generation • 23B • Updated Jun 2 • 546 • 1

Imrishav87639/DeepSeek-V4-Flash-Base

292B • Updated Jun 2 • 3

mradermacher/GLM-5.1-Abliterated-i1-GGUF

0.3B • Updated Jun 4 • 40

anhnguyen002/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 2 • 2

inclusionAI/Ling-2.6-flash-base

Text Generation • 108B • Updated 23 days ago • 261 • 13

spellbound-eng/hy3-spellbound-simpo-r256-b10-g3-sft0p1-lr2e-6-step303-merged-fp8

295B • Updated Jun 2

inclusionAI/Ling-2.6-1T-base

Text Generation • 1T • Updated 23 days ago • 320 • 13

RedHatAI/Mellum2-12B-A2.5B-Thinking-FP8-Dynamic

12B • Updated Jun 12 • 7

estebanwito/MiMo-V2.5-Pro

Text Generation • 1T • Updated Jun 2 • 4

Abiray/Wan22_Bernini_FP8_Scaled

Image-Text-to-Video • Updated Jun 2 • 24

Rp2609/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 2 • 2

hchitte/DeepSeek-V4-Flash-baseline-nvfp4

Text Generation • 158B • Updated Jun 2 • 18

jrrhf/DeepSeek-V4-Flash

Text Generation • 158B • Updated Jun 3 • 2

INSAIT-Institute/MamayLM-Gemma-3-27B-IT-v2.0-FP8-dynamic

Image-Text-to-Text • 29B • Updated Jun 3 • 211 • 2

wdfgyuagguf/DeepSeek-V4-Pro-NVFP4-FREE

Text Generation • 910B • Updated Jun 3 • 8

linustws/MiMo-V2.5

311B • Updated Jun 3 • 3

Asmita2682hshs/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 3 • 2

janfeddersen-wq/DeepSeek-V4-Flash-ega

Text Generation • 158B • Updated Jun 3 • 4 • 1

bahadirakdemir/gemma-4-12B-it-text-fp8

Text Generation • 12B • Updated Jun 3 • 825 • 2

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated Jun 3 • 107 • 2

AxionML/Gemma-4-12B-FP8

Image-Text-to-Text • 12B • Updated Jun 4 • 45.1k • 3

Rezaul66877/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 4 • 2

Rifky/LFM2.5-8B-A1B-FP8

8B • Updated Jun 4 • 666 • 2

coolthor/gemma-4-12B-it-FP8-dynamic

Any-to-Any • 12B • Updated Jun 5 • 4.36k • 1

morriszjm/Qwen3-30B-A3B-FP8-Dynamic

Text Generation • 31B • Updated Jun 4 • 2 • 1

vrfai/gemma-4-12B-it-fp8

Text Generation • 12B • Updated Jun 6 • 1.43k • 3

GermGix/Mistral-Medium-3.5-128B

128B • Updated Jun 4 • 5

khaduyen1993/qwen3.6-27b

Image-Text-to-Text • 28B • Updated Jun 4 • 10

palmfuture/gemma-4-12B-it-FP8

Any-to-Any • 12B • Updated Jun 4 • 343 • 1