Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,451

Base only

Active filters: quantization

hongweimeng/Qwen3.5-35B-A3B-AWQ-INT4

Image-Text-to-Text • Updated 28 days ago • 31

mradermacher/grok-oss-Apollyon-24B-heretic-GGUF

24B • Updated Jul 10 • 612

mradermacher/grok-oss-Apollyon-24B-heretic-i1-GGUF

24B • Updated Jul 10 • 3.74k • 1

wazimondo/Qwen-Image-Edit-2511-int4-tensorwise-mixed

tetracta/llm-xray-twin-study-1b

Updated 27 days ago • 1

claroche1/nsnet-dse-artifacts

WaveCut/FLUX.2-klein-9B-OrbitQuant-W4A4

Text-to-Image • 5B • Updated about 1 month ago • 17 • 2

operajdw/lossless-ternary

Updated Jul 10 • 1

rwillox/Ornith-1.0-35B-int4-AutoRound

1B • Updated Jul 11 • 151

Helllbos/Qwen2.5-7B-Instruct-INT8-Quanto

Text Generation • 8B • Updated Jul 10 • 8

KryptykAngel/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-i1-GGUF

Text Generation • 27B • Updated Jul 11 • 3.38k

aquaman164/MiniMax-M3-VQ-2.4bit

Text Generation • 39B • Updated Jul 11 • 63

BCCard/MoAI-gemma-4-31B-it-mxfp4

18B • Updated Jul 12 • 225

realrebelai/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated Jul 12 • 1.7k • 12

Litwein/Qwable-v2-oQ4e-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 6B • Updated Jul 11 • 444 • 3

Danny-Dasilva/gemma-4-12B-it-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 11 • 291

Litwein/Qwable-v2-oQ4e-DWQ-MTP-MLX

Text Generation • 6B • Updated Jul 11 • 169

maczzinatui/Tess-4-27B-ROCmFP4_FAST-GGUF

27B • Updated Jul 11 • 4.51k • 1

maczzinatui/Tess-4-27B-TQ3_4S-GGUF

27B • Updated Jul 11 • 42 • 1

maczzinatui/ThinkingCap-Qwen3.6-27B-TQ3_4S-GGUF

27B • Updated Jul 11 • 172 • 2

FarhanAK128/Optipros

BCCard/MoAI-gemma-4-12B-it-mxfp4

7B • Updated Jul 12 • 68

lite-infer/flux.1-kontext-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Image-to-Image • 5B • Updated Jul 12 • 2

lite-infer/flux.1-kontext-dev-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Image-to-Image • 6B • Updated Jul 12 • 2

lite-infer/flux.1-schnell-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 12

lite-infer/flux.1-schnell-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 6B • Updated Jul 12 • 13

lite-infer/flux.1-krea-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 9

lite-infer/flux.1-krea-dev-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 6B • Updated Jul 12 • 10

lite-infer/flux.1-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 29

lite-infer/flux.1-dev-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 6B • Updated Jul 12 • 5