Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,565

Full-text search

Active filters: imatrix

mradermacher/llama-3-youko-70b-i1-GGUF

71B • Updated Sep 3, 2024 • 91

mradermacher/c4ai-command-r-v01-i1-GGUF

35B • Updated Apr 16, 2025 • 337 • 3

hellork/deepseek-coder-6.7b-instruct-IQ4_NL-GGUF

7B • Updated Sep 17, 2024 • 4

mradermacher/dolphincoder-starcoder2-15b-i1-GGUF

16B • Updated Jul 15, 2025 • 277 • 2

mradermacher/Star-Command-R-32B-v1-i1-GGUF

32B • Updated Sep 8, 2024 • 57 • 4

mradermacher/AlfaCentaury11B-i1-GGUF

7B • Updated Sep 2, 2024 • 81 • 1

mradermacher/Colossal-LLaMA-2-7b-base-i1-GGUF

7B • Updated Sep 3, 2024 • 132

mradermacher/Llama-3.1-8B-Instruct-EmailSpam-Finetuned-i1-GGUF

8B • Updated Sep 2, 2024 • 16

mradermacher/llama3.1-70B-upscaled-105B-i1-GGUF

105B • Updated Sep 4, 2024 • 63 • 1

mradermacher/Athlon-8B-0.1-i1-GGUF

8B • Updated Sep 2, 2024 • 147 • 1

Vdr1/L3.1-8B-komorebi-v0.1-GGUF-IQ

8B • Updated Sep 3, 2024 • 12 • 1

mradermacher/Llama-3.1-8B-Instruct-Phishing-Classification-i1-GGUF

8B • Updated Sep 2, 2024 • 27

mradermacher/Reasoner-Llama3.1-70b-i1-GGUF

71B • Updated Sep 3, 2024 • 66

FourOhFour/Zenith_4B_GGUF_Q4_0_4x8

5B • Updated Sep 2, 2024 • 1

FourOhFour/QuantuMinx_4B_GGUF_Q4_0_4x8

5B • Updated Sep 2, 2024 • 1

mradermacher/deepseek-coder-1.3b-base-i1-GGUF

1B • Updated Dec 14, 2024 • 183

mradermacher/Llama-3.1-8B-Instruct-EmailSpam-Finetuned-0.1-i1-GGUF

8B • Updated Sep 2, 2024 • 99

mradermacher/Meta-Llama-3.1-8B-Instruct_CODE_Python_English_Asistant-16bit-v2-i1-GGUF

8B • Updated Sep 2, 2024 • 290 • 2

mradermacher/Mistral-Nemo-Instruct-2407-abliterated-i1-GGUF

12B • Updated Sep 2, 2024 • 875 • 5

mradermacher/Zenith_4B-i1-GGUF

5B • Updated Sep 2, 2024 • 154

mradermacher/uf-tulu-2-7b-dpo-i1-GGUF

7B • Updated Sep 2, 2024 • 151

FourOhFour/Luxe_4B_GGUF_Q4_0_4x8

5B • Updated Sep 3, 2024 • 1

mradermacher/starcoder2-15b-i1-GGUF

16B • Updated Sep 3, 2024 • 3.14k • 1

bartowski/Star-Command-R-32B-v1-GGUF

Text Generation • 32B • Updated Sep 3, 2024 • 106 • 2

mradermacher/zephyr-7b-hh-dpo-i1-GGUF

7B • Updated Sep 3, 2024 • 67

duyntnet/LongWriter-glm4-9b-imatrix-GGUF

Text Generation • 9B • Updated Sep 3, 2024 • 75 • 1

mradermacher/Colossal-LLaMA-2-13b-base-i1-GGUF

13B • Updated Sep 3, 2024 • 374

DavidAU/L3-Dark-Planet-8B-NEO-Imatrix-GGUF

Text Generation • 8B • Updated Jul 28, 2025 • 527 • 8

mradermacher/Phenom-12B-0.1-i1-GGUF

12B • Updated Sep 3, 2024 • 287 • 7

mradermacher/deepseek-coder-1.3b-instruct-i1-GGUF

1B • Updated Sep 3, 2024 • 2.71k • 1