Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29,105

Base only

Active filters: imatrix

hellork/deepseek-coder-6.7b-instruct-IQ4_NL-GGUF

7B • Updated Sep 17, 2024 • 29

mradermacher/dolphincoder-starcoder2-15b-i1-GGUF

16B • Updated Jul 15, 2025 • 1.83k • 2

mradermacher/Star-Command-R-32B-v1-i1-GGUF

32B • Updated Sep 8, 2024 • 260 • 4

mradermacher/AlfaCentaury11B-i1-GGUF

7B • Updated Sep 2, 2024 • 80 • 1

mradermacher/Colossal-LLaMA-2-7b-base-i1-GGUF

7B • Updated Sep 3, 2024 • 512

mradermacher/Llama-3.1-8B-Instruct-EmailSpam-Finetuned-i1-GGUF

8B • Updated Sep 2, 2024 • 35

mradermacher/llama3.1-70B-upscaled-105B-i1-GGUF

105B • Updated Sep 4, 2024 • 36 • 1

mradermacher/Athlon-8B-0.1-i1-GGUF

8B • Updated Sep 2, 2024 • 125 • 1

Vdr1/L3.1-8B-komorebi-v0.1-GGUF-IQ

8B • Updated Sep 3, 2024 • 11 • 1

mradermacher/Llama-3.1-8B-Instruct-Phishing-Classification-i1-GGUF

8B • Updated Sep 2, 2024 • 61

mradermacher/Reasoner-Llama3.1-70b-i1-GGUF

71B • Updated Sep 3, 2024 • 50

FourOhFour/Zenith_4B_GGUF_Q4_0_4x8

5B • Updated Sep 2, 2024 • 10

FourOhFour/QuantuMinx_4B_GGUF_Q4_0_4x8

5B • Updated Sep 2, 2024 • 5 • 1

mradermacher/deepseek-coder-1.3b-base-i1-GGUF

1B • Updated Dec 14, 2024 • 208

mradermacher/Llama-3.1-8B-Instruct-EmailSpam-Finetuned-0.1-i1-GGUF

8B • Updated Sep 2, 2024 • 7

mradermacher/Meta-Llama-3.1-8B-Instruct_CODE_Python_English_Asistant-16bit-v2-i1-GGUF

8B • Updated Sep 2, 2024 • 499 • 2

mradermacher/Mistral-Nemo-Instruct-2407-abliterated-i1-GGUF

12B • Updated Sep 2, 2024 • 692 • 5

mradermacher/Zenith_4B-i1-GGUF

5B • Updated Sep 2, 2024 • 346

mradermacher/uf-tulu-2-7b-dpo-i1-GGUF

7B • Updated Sep 2, 2024 • 436

FourOhFour/Luxe_4B_GGUF_Q4_0_4x8

5B • Updated Sep 3, 2024 • 6

mradermacher/starcoder2-15b-i1-GGUF

16B • Updated Sep 3, 2024 • 1.14k • 1

bartowski/Star-Command-R-32B-v1-GGUF

Text Generation • 32B • Updated Sep 3, 2024 • 1.34k • 2

mradermacher/zephyr-7b-hh-dpo-i1-GGUF

7B • Updated Sep 3, 2024 • 1.49k

duyntnet/LongWriter-glm4-9b-imatrix-GGUF

Text Generation • 9B • Updated Sep 3, 2024 • 52 • 1

mradermacher/Colossal-LLaMA-2-13b-base-i1-GGUF

13B • Updated Sep 3, 2024 • 640

DavidAU/L3-Dark-Planet-8B-NEO-Imatrix-GGUF

Text Generation • 8B • Updated Jul 28, 2025 • 307 • 8

mradermacher/Phenom-12B-0.1-i1-GGUF

12B • Updated Sep 3, 2024 • 45 • 7

mradermacher/deepseek-coder-1.3b-instruct-i1-GGUF

1B • Updated Sep 3, 2024 • 407 • 2

mradermacher/c4ai-command-r-08-2024-i1-GGUF

32B • Updated Apr 16, 2025 • 450 • 3

mradermacher/granite-3b-code-base-2k-i1-GGUF

3B • Updated Sep 3, 2024 • 425