Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,493

Base only

Active filters: imatrix

mradermacher/Meditron3-Phi4-14B-i1-GGUF

15B • Updated 18 days ago • 1.81k • 1

mradermacher/Medical-QnA-gpt2-i1-GGUF

0.2B • Updated Jul 11, 2025 • 428 • 1

bartowski/TheDrummer_Fallen-Gemma3-27B-v1-GGUF

Text Generation • 27B • Updated Mar 22, 2025 • 6.46k • 26

mradermacher/Qwen2.5-VL-32B-Instruct-i1-GGUF

33B • Updated Jun 10 • 371 • 1

mradermacher/gemma-2b-ForexAI-i1-GGUF

Text Generation • 3B • Updated Jul 11, 2025 • 517 • 2

bartowski/meta-llama_Llama-4-Scout-17B-16E-Instruct-old-GGUF

Text Generation • 108B • Updated Apr 8, 2025 • 1.37k • 32

unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text • 108B • Updated Jun 17, 2025 • 36.7k • 163

unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF

Image-Text-to-Text • 401B • Updated Jun 18, 2025 • 6.02k • 51

bartowski/deepcogito_cogito-v1-preview-qwen-32B-GGUF

Text Generation • 33B • Updated Apr 9, 2025 • 1.64k • 16

mradermacher/Qwen2.5-VL-7B-Instruct-abliterated-i1-GGUF

8B • Updated Jul 10, 2025 • 4.6k • 8

mradermacher/AtomThink-LLaVA1.5-7B-i1-GGUF

7B • Updated Jul 3 • 437 • 1

unsloth/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jun 8, 2025 • 26.7k • 286

bartowski/Qwen_Qwen2.5-VL-72B-Instruct-GGUF

Image-Text-to-Text • 73B • Updated May 10, 2025 • 2.66k • 4

mradermacher/InternVL3-38B-Instruct-i1-GGUF

33B • Updated Aug 31, 2025 • 546 • 3

mradermacher/FalconEye-i1-GGUF

8B • Updated 28 days ago • 754 • 1

unsloth/medgemma-27b-text-it-GGUF

Image-Text-to-Text • 27B • Updated May 20, 2025 • 5.36k • 74

mradermacher/Llama-4-Scout-17B-16E-Instruct-abliterated-v2-i1-GGUF

108B • Updated Jul 11, 2025 • 873 • 7

ubergarm/Kimi-Dev-72B-GGUF

Text Generation • 73B • Updated Jul 10, 2025 • 71 • 3

mradermacher/MS3.2-24B-Magnum-Diamond-i1-GGUF

24B • Updated Jul 11, 2025 • 429 • 6

bartowski/tencent_Hunyuan-A13B-Instruct-GGUF

Text Generation • 80B • Updated Jul 8, 2025 • 522 • 5

mradermacher/WebSailor-3B-i1-GGUF

3B • Updated Jul 11, 2025 • 138 • 1

DavidAU/Qwen3-Zero-Coder-Reasoning-0.8B-NEO-EX-GGUF

Text Generation • 0.8B • Updated Jul 28, 2025 • 3.64k • 28

Phr00t/Phr00tyMix-v4-32B-GGUF

33B • Updated Jul 18, 2025 • 873 • 13

mradermacher/Huihui-EXAONE-4.0-1.2B-abliterated-i1-GGUF

1B • Updated Jul 19, 2025 • 176 • 1

bartowski/Qwen_Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • 31B • Updated Jul 29, 2025 • 13.8k • 29

unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF

31B • Updated Jul 31, 2025 • 345k • 316

unsloth/Qwen3-30B-A3B-Thinking-2507-GGUF

31B • Updated Jul 31, 2025 • 1.27M • 144

mradermacher/Mantella-Skyrim-Llama-3-8B-abliterated-i1-GGUF

8B • Updated Dec 25, 2025 • 263 • 2

LatitudeGames/Nova-70B-Llama-3.3-GGUF

71B • Updated Sep 1, 2025 • 7.32k • 13

bartowski/Qwen_Qwen3-Next-80B-A3B-Instruct-GGUF

Text Generation • 80B • Updated Mar 1 • 13.2k • 21