Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,574

Full-text search

Active filters: imatrix

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 44 • 1

mradermacher/magnummergev2-i1-GGUF

5B • Updated Dec 16, 2024 • 114 • 1

mradermacher/mistral-nemo-gutenberg-12B-v4-i1-GGUF

12B • Updated Aug 23, 2024 • 198 • 4

mradermacher/Loki-v5.1-i1-GGUF

7B • Updated Aug 23, 2024 • 90 • 1

mradermacher/LightGPT-13B-Llama2-i1-GGUF

13B • Updated Aug 23, 2024 • 139

mradermacher/MN-18.5B-Celeste-V1.9-Story-Wizard-ED1-Instruct-i1-GGUF

19B • Updated Aug 23, 2024 • 86 • 2

mradermacher/MemGPT-Nemo-i1-GGUF

12B • Updated Dec 16, 2024 • 122 • 1

mradermacher/Iceball-Phi-3.5-mini-instruct-shareGPT-v1.0-i1-GGUF

4B • Updated Aug 23, 2024 • 125 • 1

mradermacher/NemoMix-Unleashed-12B-i1-GGUF

12B • Updated Feb 6, 2025 • 2.34k • 20

mradermacher/Ultra-Instruct-12B-i1-GGUF

12B • Updated Aug 23, 2024 • 120 • 1

mradermacher/Athena-codegemma-2-9b-v1-i1-GGUF

9B • Updated Aug 23, 2024 • 126 • 1

anthracite-org/magnum-v2-4b-gguf

Text Generation • 5B • Updated Aug 27, 2024 • 116 • 7

mradermacher/Niitaris-15B-L3-i1-GGUF

15B • Updated Aug 23, 2024 • 60

mradermacher/Shi-Ci_v3_Avocet-i1-GGUF

33B • Updated Aug 24, 2024 • 86

adamo1139/magnum-v2-4b-gguf-lowctx

5B • Updated Aug 27, 2024 • 112

unclemusclez/tinyllama-chat-IQ3_XXS-GGUF

1B • Updated Aug 23, 2024 • 2

duyntnet/internlm2_5-7b-chat-1m-imatrix-GGUF

Text Generation • 8B • Updated Aug 24, 2024 • 55

hellork/Infinity-Instruct-3M-0625-Qwen2-7B-IQ4_NL-GGUF

8B • Updated Sep 17, 2024 • 1

hellork/internlm2_5-7b-chat-IQ4_NL-GGUF

Text Generation • 8B • Updated Sep 17, 2024 • 4

Cran-May/Qwen2-0.5B-Abyme-Q5_K_M-GGUF

0.5B • Updated Aug 24, 2024 • 14

Cran-May/Infinity-Instruct-7M-Gen-Llama3_1-8B-Q4_K_M-GGUF

8B • Updated Aug 24, 2024 • 4

Cran-May/Infinity-Instruct-7M-Gen-mistral-7B-Q4_K_M-GGUF

7B • Updated Aug 24, 2024 • 2

Cran-May/E5-Q5_K_M-GGUF

7B • Updated Aug 24, 2024 • 1

mradermacher/calme-2.1-phi3.5-4b-i1-GGUF

4B • Updated Aug 24, 2024 • 108 • 1

mradermacher/Athene-Phi-3.5-mini-instruct-orpo-i1-GGUF

4B • Updated Dec 16, 2024 • 522

mradermacher/llama3.1-airoboros3.2-QDT-8B-i1-GGUF

8B • Updated Aug 24, 2024 • 162

mradermacher/L3.1-Ablaze-Vulca-v0.1-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 68 • 1

mradermacher/L3-SMB-Grand-Story-WTFrack-Instruct-18.05B-i1-GGUF

18B • Updated Aug 24, 2024 • 48

mradermacher/Grand-Story-V1-F32-Ultra-Quality-16_5B-i1-GGUF

17B • Updated Aug 24, 2024 • 101

mradermacher/L3-Jamet-12.2B-MK.V-Blackroot-Instruct-i1-GGUF

12B • Updated Aug 24, 2024 • 181