Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28,671

Base only

Active filters: imatrix

bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Mar 7, 2025 • 40.8k • 122

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • 71B • Updated May 10, 2025 • 25k • 114

mradermacher/Mistral-Small-24B-Instruct-2501-i1-GGUF

24B • Updated Jul 25, 2025 • 549 • 6

LatitudeGames/Wayfarer-Large-70B-Llama-3.3-GGUF

71B • Updated Feb 19, 2025 • 665 • 29

mradermacher/GPT-NeoX-20B-Erebus-i1-GGUF

21B • Updated Feb 17, 2025 • 369 • 1

mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF

24B • Updated Feb 21, 2025 • 685 • 14

mradermacher/SummLlama3-8B-i1-GGUF

8B • Updated Feb 25, 2025 • 194 • 2

bartowski/microsoft_Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated Feb 28, 2025 • 11.2k • 41

bartowski/huihui-ai_QwQ-32B-abliterated-GGUF

Text Generation • 33B • Updated Mar 7, 2025 • 5.16k • 80

mradermacher/bitnet_b1_58-large-i1-GGUF

0.7B • Updated Mar 13, 2025 • 128 • 1

mradermacher/Qwen2-Boundless-i1-GGUF

2B • Updated Jul 11, 2025 • 323 • 1

bartowski/TheDrummer_Fallen-Gemma3-27B-v1-GGUF

Text Generation • 27B • Updated Mar 22, 2025 • 6.46k • 21

mradermacher/Eurydice-24b-v2-i1-GGUF

24B • Updated Jul 11, 2025 • 2.2k • 6

mradermacher/UI-TARS-1.5-7B-i1-GGUF

8B • Updated Jul 10, 2025 • 286 • 4

mradermacher/Llama-Primus-Nemotron-70B-Instruct-i1-GGUF

71B • Updated Aug 11, 2025 • 304 • 1

mradermacher/Mellum-4b-sft-python-i1-GGUF

4B • Updated Jul 11, 2025 • 392 • 3

Aratako/Qwen3-30B-A3B-ERP-v0.1-GGUF

31B • Updated May 8, 2025 • 1.31k • 12

unsloth/medgemma-27b-text-it-GGUF

Image-Text-to-Text • 27B • Updated May 20, 2025 • 8.77k • 69

mradermacher/EsotericSage-12B-i1-GGUF

12B • Updated Jul 11, 2025 • 981 • 5

mradermacher/Josiefied-DeepSeek-R1-0528-Qwen3-8B-abliterated-v1-i1-GGUF

8B • Updated Jul 11, 2025 • 753 • 19

leeroy-jankins/leeroy

1B • Updated 3 days ago • 60 • 1

mradermacher/Dans-PersonalityEngine-V1.3.0-24b-i1-GGUF

24B • Updated Jul 11, 2025 • 428 • 4

mradermacher/LorablatedStock-12B-i1-GGUF

12B • Updated Jul 11, 2025 • 360 • 5

mradermacher/Qwen3-16B-A3B-abliterated-i1-GGUF

16B • Updated Jul 11, 2025 • 183 • 1

mradermacher/mxbai-large-i1-GGUF

0.3B • Updated Jul 11, 2025 • 69 • 1

unsloth/Kimi-Dev-72B-GGUF

73B • Updated Jun 17, 2025 • 2.89k • 53

unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF

31B • Updated Jul 31, 2025 • 660k • 309

unsloth/Qwen3-Coder-30B-A3B-Instruct-1M-GGUF

Text Generation • 31B • Updated Aug 5, 2025 • 12.9k • 151

DavidAU/Openai_gpt-oss-120b-NEO-Imatrix-GGUF

Text Generation • 117B • Updated Aug 7, 2025 • 276 • 23

DavidAU/OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf

Text Generation • 21B • Updated Nov 17, 2025 • 38.2k • 499