Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,596

Full-text search

Active filters: imatrix

bartowski/functionary-medium-v3.2-GGUF

Text Generation • 71B • Updated Aug 22, 2024 • 36 • 2

mattritchey/Llama3-DocChat-1.0-8B-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 22, 2024

mradermacher/Sellen-8B-model_stock-i1-GGUF

8B • Updated Sep 8, 2024 • 56 • 1

mradermacher/LightGPT-7B-Llama2-i1-GGUF

7B • Updated Sep 8, 2024 • 1.11k

hellork/CodeQwen1.5-7B-Chat-IQ4_NL-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 4

hellork/gemma-2-2b-it-IQ4_NL-GGUF

Text Generation • 3B • Updated Sep 17, 2024 • 4

hellork/Phi-3.5-mini-instruct-IQ4_NL-GGUF

Text Generation • 4B • Updated Sep 17, 2024 • 13

mradermacher/Deutscher-Pantheon-12B-i1-GGUF

12B • Updated Aug 23, 2024 • 113 • 1

mradermacher/Mixtral-8x22B-v0.1-i1-GGUF

141B • Updated Jul 26, 2025 • 101

mradermacher/Fireball-12B-v1.0-finance-i1-GGUF

12B • Updated Aug 23, 2024 • 106

mradermacher/Llama-3.1-8B-Stheno-v3.4-abliterated-i1-GGUF

8B • Updated Aug 23, 2024 • 278 • 5

mradermacher/GracieRP-freefallenLora-Gemma2-Inst-9B-i1-GGUF

9B • Updated Aug 23, 2024 • 36 • 1

adamo1139/danube3-4b-turtle-2208-gguf

4B • Updated Aug 28, 2024 • 15

mradermacher/Fireball-12B-v1.0-i1-GGUF

12B • Updated Aug 23, 2024 • 72 • 1

mradermacher/Loki-v5.2-i1-GGUF

7B • Updated Aug 23, 2024 • 70 • 1

mradermacher/Flash_Fiction-FineLlama-3.1-8B-i1-GGUF

8B • Updated Aug 23, 2024 • 212

mradermacher/KAI-7B-Instruct-v0.1-i1-GGUF

7B • Updated Aug 23, 2024 • 510

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 44 • 1

mradermacher/magnummergev2-i1-GGUF

5B • Updated Dec 16, 2024 • 118 • 1

mradermacher/mistral-nemo-gutenberg-12B-v4-i1-GGUF

12B • Updated Aug 23, 2024 • 199 • 4

mradermacher/Loki-v5.1-i1-GGUF

7B • Updated Aug 23, 2024 • 90 • 1

mradermacher/LightGPT-13B-Llama2-i1-GGUF

13B • Updated Aug 23, 2024 • 139

mradermacher/MN-18.5B-Celeste-V1.9-Story-Wizard-ED1-Instruct-i1-GGUF

19B • Updated Aug 23, 2024 • 86 • 2

mradermacher/MemGPT-Nemo-i1-GGUF

12B • Updated Dec 16, 2024 • 115 • 1

mradermacher/Iceball-Phi-3.5-mini-instruct-shareGPT-v1.0-i1-GGUF

4B • Updated Aug 23, 2024 • 124 • 1

mradermacher/NemoMix-Unleashed-12B-i1-GGUF

12B • Updated Feb 6, 2025 • 2.42k • 20

mradermacher/Ultra-Instruct-12B-i1-GGUF

12B • Updated Aug 23, 2024 • 117 • 1

mradermacher/Athena-codegemma-2-9b-v1-i1-GGUF

9B • Updated Aug 23, 2024 • 127 • 1

anthracite-org/magnum-v2-4b-gguf

Text Generation • 5B • Updated Aug 27, 2024 • 116 • 7

mradermacher/Niitaris-15B-L3-i1-GGUF

15B • Updated Aug 23, 2024 • 63