Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

488

Base only

Active filters: llm-compressor

tabrezahmed51/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Apr 7 • 14

ebircak/gemma-4-31B-it-4bit-W4A16-AWQ

Text Generation • 32B • Updated Apr 7 • 223k • 3

Hyun9junn/K-EXAONE-236B-A23B-W4A16-G128

Text Generation • 33B • Updated Jun 4 • 16 • 1

YuYu1015/Huihui-Qwen3-30B-A3B-Thinking-2507-abliterated-NVFP4

Text Generation • 17B • Updated Apr 12 • 17

YuYu1015/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-NVFP4

Text Generation • 17B • Updated Apr 12 • 574

YuYu1015/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-NVFP4

Text Generation • 7B • Updated Apr 13 • 25

YuYu1015/Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated-NVFP4

Text Generation • 3B • Updated Apr 13 • 13

YuYu1015/Huihui-Qwopus3.5-27B-v3-abliterated-NVFP4

Text Generation • 19B • Updated Apr 13 • 13 • 1

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 26 • 12.8k • 1

jamesleeht/gemma-4-31B-it-FP8-block-8192

Image-Text-to-Text • 31B • Updated Apr 15 • 10

ghecko78/Voxtral-Mini-4B-Realtime-2602-FP8-Dynamic

Automatic Speech Recognition • 4B • Updated May 22 • 608 • 2

wjacksonrd/prometheus-8x7b-v2.0-W4A16

Text Generation • 6B • Updated Apr 17 • 33

RedHatAI/Qwen3.5-4B-quantized.w4a16

Image-Text-to-Text • 5B • Updated Apr 16 • 14.5k • 1

RedHatAI/Qwen3.5-9B-quantized.w8a8

Image-Text-to-Text • 9B • Updated Apr 16 • 154k • 2

LittleNicky55/MiniMax-M2.7-abliterated-Heretic-FP8

Text Generation • 229B • Updated Apr 19 • 25 • 2

0ppxnhximxr/gemma-4-31B-it-heretic-FP8-Dynamic

Image-Text-to-Text • 33B • Updated Apr 19 • 1.33k • 1

lovethayo/MiniMax-M2.5-FP8-INT4-AWQ

Text Generation • 39B • Updated Apr 20 • 10

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 9

ocicek/Qwen3.6-27B-NVFP4

Text Generation • 17B • Updated May 2 • 2.29k • 7

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • 21B • Updated Jun 8 • 5.13k • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 67 • 1

RedHatAI/Qwen3.6-35B-A3B-FP8-dynamic

Image-Text-to-Text • 35B • Updated Jul 13 • 13.4k • 5

RedHatAI/Kimi-K2.6-FP8-BLOCK

Image-Text-to-Text • 1T • Updated 30 days ago • 28.2k • 4

RedHatAI/Kimi-K2.6-NVFP4

Image-Text-to-Text • Updated 29 days ago • 3.23k • 13

depop-ml/Qwen3.5-9B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated May 27 • 100 • 3

RedHatAI/Qwen3.6-35B-A3B-FP8

Image-Text-to-Text • 36B • Updated 2 days ago • 8.09k

zdy1995love/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 74B • Updated May 3 • 1.36k • 3

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 657 • 4

darkc0de/gemma-4-31B-it-heretic-FP8-Dynamic-Q4_K_M-GGUF

Image-Text-to-Text • 31B • Updated May 2 • 572 • 3

amir22010/sarvam-30b-gptq-4bit

Text Generation • 32B • Updated Jun 15