Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,493

Base only

Active filters: imatrix

bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF

Text Generation • 80B • Updated Mar 1 • 111k • 16

mradermacher/PromptEnhancer-32B-i1-GGUF

Text-to-Image • 33B • Updated Dec 10, 2025 • 385 • 1

neuphonic/neutts-air-q8-gguf

Text-to-Speech • 0.7B • Updated Feb 10 • 57k • 43

mradermacher/PromptEnhancer-Img2img-Edit-i1-GGUF

Text-to-Image • 33B • Updated Dec 9, 2025 • 2.44k • 1

mradermacher/WilR-mini-i1-GGUF

4B • Updated 20 days ago • 1.55k • 1

redponike/Ling-mini-2.0-GGUF-ik

Text Generation • 16B • Updated Oct 16, 2025 • 233 • 2

mradermacher/Luau-Qwen3-4B-FIM-v0.1-i1-GGUF

4B • Updated Dec 7, 2025 • 194 • 2

bartowski/cerebras_GLM-4.5-Air-REAP-82B-A12B-GGUF

Text Generation • 85B • Updated Oct 23, 2025 • 1.7k • 44

noctrex/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF

Image-Text-to-Text • 31B • Updated Nov 7, 2025 • 45.3k • 30

unsloth/Qwen3-VL-30B-A3B-Thinking-GGUF

Image-Text-to-Text • 31B • Updated Jan 1 • 40.6k • 42

unsloth/Qwen3-VL-30B-A3B-Instruct-GGUF

Image-Text-to-Text • 31B • Updated Jan 1 • 115k • 108

mradermacher/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-i1-GGUF

31B • Updated Dec 4, 2025 • 2.46k • 6

DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf

Text Generation • 21B • Updated Jun 12 • 23.6k • 172

mradermacher/GAD-GPT-5-Chat-Qwen2.5-7B-Instruct-i1-GGUF

8B • Updated Dec 6, 2025 • 1.31k • 1

mradermacher/Big-Tiger-Gemma-27B-v3-heretic-i1-GGUF

27B • Updated Dec 6, 2025 • 720 • 5

unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF

Text Generation • 80B • Updated Jan 14 • 29.8k • 195

unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF

Text Generation • 80B • Updated Jan 14 • 14.2k • 80

ReadyArt/GLM-4.6-Derestricted-GGUF

357B • Updated May 1 • 5.7k • 27

neuphonic/neutts-nano-q4-gguf

Text-to-Speech • 0.2B • Updated Feb 12 • 2.2k • 16

neuphonic/neutts-nano-q8-gguf

Text-to-Speech • 0.2B • Updated Feb 12 • 654 • 24

unsloth/Devstral-2-123B-Instruct-2512-GGUF

125B • Updated Dec 15, 2025 • 3.63k • 56

unsloth/Nemotron-3-Nano-30B-A3B-GGUF

Text Generation • 32B • Updated Dec 31, 2025 • 15.8k • 328

ServiceNow-AI/Apriel-1.6-15b-Thinker-GGUF

14B • Updated Dec 16, 2025 • 236 • 16

mradermacher/Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated-i1-GGUF

80B • Updated Dec 22, 2025 • 1.15k • 3

unsloth/GLM-4.7-GGUF

Text Generation • 358B • Updated Dec 27, 2025 • 5.64k • 223

llmware/qwen2.5-vl-3b-instruct-gguf

3B • Updated Dec 28, 2025 • 1.16k • 1

mradermacher/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-i1-GGUF

8B • Updated Jan 2 • 87.7k • 75

mradermacher/Heretic-Nemotron-Content-Safety-Reasoning-4B-i1-GGUF

4B • Updated 20 days ago • 1.75k • 2

mradermacher/LlamaForecaster-8B-i1-GGUF

Question Answering • 8B • Updated Jan 10 • 837 • 4

ruv/ruvltra-small

Text Generation • 0.5B • Updated Mar 28 • 311 • 1