Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

270

Base only

Active filters: llm-compressor

ebircak/gemma-4-31B-it-4bit-W4A16-GPTQ

Text Generation • 32B • Updated Apr 5 • 9.75k • 3

ebircak/gemma-4-31B-it-4bit-NVFP4A16-GPTQ

Text Generation • 18B • Updated Apr 5 • 4.35k • 2

frankmorales2020/sarvam-30b-fp8-unesco-resilient

32B • Updated Apr 30 • 1.14k

tacodevs/Behemoth-T1-123B-FP8

Text Generation • 123B • Updated Apr 7 • 8

tacodevs/Behemoth-T1-123B-GPTQ

Text Generation • 17B • Updated Apr 7 • 3

coolthor/Gemma-4-E4B-it-NVFP4A16

Image-Text-to-Text • 7B • Updated 5 days ago • 11k • 1

tabrezahmed51/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Apr 7 • 2

Hyun9junn/K-EXAONE-236B-A23B-W4A16-G128

Text Generation • 33B • Updated 3 days ago • 172 • 1

YuYu1015/Huihui-Qwen3-30B-A3B-Thinking-2507-abliterated-NVFP4

Text Generation • 17B • Updated Apr 12 • 23

dhruvil237/gemma-4-26B-A4B-it-W4A16

Image-Text-to-Text • 26B • Updated Apr 27 • 5.64k • 3

lyf/Huihui-gemma-4-31B-it-abliterated-v2-NVFP4

Image-Text-to-Text • 18B • Updated Apr 12 • 91.5k • 1

YuYu1015/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-NVFP4

Text Generation • 17B • Updated Apr 12 • 21

YuYu1015/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-NVFP4

Text Generation • 7B • Updated Apr 13 • 254

YuYu1015/Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated-NVFP4

Text Generation • 3B • Updated Apr 13 • 11

YuYu1015/Huihui-Qwopus3.5-27B-v3-abliterated-NVFP4

Text Generation • 19B • Updated Apr 13 • 3 • 1

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated 12 days ago • 863

jamesleeht/gemma-4-31B-it-FP8-block-8192

Image-Text-to-Text • 31B • Updated Apr 15 • 4

RedHatAI/Qwen3.5-4B-quantized.w8a8

Image-Text-to-Text • 5B • Updated Apr 16 • 4.14k

wjacksonrd/prometheus-8x7b-v2.0-W4A16

Text Generation • 6B • Updated Apr 17 • 3

binedge/dots.mocr-FP8

Image-Text-to-Text • 3B • Updated Apr 16 • 9.03k

RedHatAI/Qwen3.5-4B-quantized.w4a16

Image-Text-to-Text • 5B • Updated Apr 16 • 1.18k

RedHatAI/Qwen3.5-9B-quantized.w8a8

Image-Text-to-Text • 9B • Updated Apr 16 • 5.25k

LittleNicky55/MiniMax-M2.7-abliterated-Heretic-FP8

Text Generation • 229B • Updated Apr 19 • 194 • 2

binedge/Qwen3-Embedding-0.6B-FP8

Feature Extraction • 0.6B • Updated Apr 19 • 140k • 1

0ppxnhximxr/gemma-4-31B-it-heretic-FP8-Dynamic

Image-Text-to-Text • 33B • Updated Apr 19 • 303 • 1

lovethayo/MiniMax-M2.5-FP8-INT4-AWQ

Text Generation • 39B • Updated Apr 20 • 5

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 4

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • Updated Apr 26 • 415 • 2

RedHatAI/Qwen3.5-9B-quantized.w4a16

Image-Text-to-Text • 9B • Updated 27 days ago • 8.66k • 1

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 411 • 1