Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,634

Full-text search

Active filters: imatrix

mradermacher/mistral-nemo-bophades-12B-i1-GGUF

12B • Updated Aug 14, 2024 • 505 • 1

mradermacher/OpenCrystal-12B-Instruct-i1-GGUF

12B • Updated Aug 14, 2024 • 10 • 1

mradermacher/Stella-mistral-nemo-12B-i1-GGUF

12B • Updated Aug 14, 2024 • 69 • 1

mradermacher/Odal-Doctor-v1-i1-GGUF

8B • Updated Aug 14, 2024 • 15

mradermacher/Interim-MN-fp16-i1-GGUF

12B • Updated Aug 14, 2024 • 45

mradermacher/NemoRemix-Magnum_V2_Base-12B-i1-GGUF

12B • Updated Aug 14, 2024 • 87 • 2

mradermacher/Gemma-2-Ataraxy-9B-i1-GGUF

9B • Updated Oct 20, 2024 • 194 • 10

lucasdozie/gemma-2-2b-it-IQ4_NL-GGUF

Text Generation • 3B • Updated Aug 14, 2024 • 5

mradermacher/Llama3-Med42-70B-i1-GGUF

71B • Updated Aug 16, 2024 • 241 • 1

Felladrin/gguf-q5_k_l-imat-arcee-lite

2B • Updated Aug 14, 2024

Nekuromento/Gemma2-Nephilim-v3-9B-Q5_K_M-GGUF

Text Generation • 9B • Updated Aug 14, 2024

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-GGUF

47B • Updated Dec 22, 2024 • 137 • 1

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • 12B • Updated Aug 22, 2024 • 691 • 42

mradermacher/EpistemeAI-codegemma-2-9b-ultra-i1-GGUF

9B • Updated Aug 15, 2024 • 250 • 1

Reiterate3680/Rocinante-12B-v1b-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 12

mradermacher/IridiumLlama-72B-v0.1-i1-GGUF

73B • Updated Aug 15, 2024 • 34

mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF

8B • Updated Aug 15, 2024 • 5.04k

mradermacher/NemoReRemix-12B-i1-GGUF

12B • Updated Aug 15, 2024 • 213 • 3

Reiterate3680/magnum-12b-v2.5-kto-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 1 • 2

mradermacher/New-Dawn-Llama-3.1-70B-v1.1-i1-GGUF

71B • Updated Aug 15, 2024 • 155 • 6

mradermacher/LongWriter-llama3.1-8b-i1-GGUF

8B • Updated Jul 29, 2025 • 696 • 3

mradermacher/CeleMo-Instruct-128k-i1-GGUF

12B • Updated Aug 15, 2024 • 52 • 1

Reiterate3680/Aura-NeMo-12B-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 3 • 1

mradermacher/Aura32k-i1-GGUF

7B • Updated Aug 15, 2024 • 30 • 1

duyntnet/Meta-Llama-3.1-8B-imatrix-GGUF

Text Generation • 8B • Updated Aug 15, 2024 • 54

mradermacher/Iridium-72B-v0.1-i1-GGUF

73B • Updated Aug 15, 2024 • 37

mradermacher/TypeII-12B-i1-GGUF

12B • Updated Aug 15, 2024 • 34 • 1

mradermacher/Tess-3-Mistral-Nemo-12B-i1-GGUF

12B • Updated Aug 15, 2024 • 179 • 1

mradermacher/guanaco-33b-lxctx-PI-16384-LoRA-fp16-i1-GGUF

33B • Updated Aug 15, 2024 • 92

mradermacher/Wizard-Vicuna-30B-Uncensored-lxctx-PI-16384-LoRA-fp16-i1-GGUF

33B • Updated Aug 15, 2024 • 574