Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,224

Full-text search

Active filters: imatrix

duyntnet/Phi-3-mini-4k-instruct-imatrix-GGUF

Text Generation • 4B • Updated Jul 6, 2024 • 47

mradermacher/L3-MS-Astoria-8b-i1-GGUF

8B • Updated Aug 2, 2024 • 45

mradermacher/Nuit-i1-GGUF

11B • Updated Aug 2, 2024 • 24

mradermacher/L3-TenyxChat-Daybreak-Storywriter-RAE-70B-i1-GGUF

71B • Updated Aug 2, 2024 • 4

mradermacher/Hathor_Respawn-L3-8B-v0.8-i1-GGUF

8B • Updated Dec 16, 2024 • 27 • 1

mmnga/Llama3-ArrowSE-8B-v0.3-gguf

8B • Updated Jul 7, 2024 • 40

mradermacher/Mixtral-8x22B-Instruct-v0.1-i1-GGUF

141B • Updated Jul 26, 2025 • 395

mradermacher/Hermes-2.5-Yi-1.5-9B-Chat-i1-GGUF

9B • Updated Aug 2, 2024 • 183

aifeifei798/gemma2-9B-sunfall-v0.5.2-Q5_K_M-GGUF

9B • Updated Jul 7, 2024

herrkobold/Wiedervereinigung-7b-dpo-laser-Q5_K_M-GGUF

7B • Updated Jul 7, 2024 • 2

valenradovich/gemma-2-9b-it-IQ1_M-gguf

9B • Updated Jul 7, 2024 • 1

herrkobold/TinyLlama-1.1B-Chat-v1.0-german-Q5_K_M-GGUF

1B • Updated Jul 7, 2024 • 2

mradermacher/L3-Inverted-Colours-RP-OVA-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 4

Quant-Cartel/L3-TenyxChat-Daybreak-Storywriter-RAE-70B-iMat-GGUF

71B • Updated Jul 11, 2024 • 14

mradermacher/Psyonic-Rose-20B-Higher-Quality-i1-GGUF

20B • Updated Aug 2, 2024 • 58 • 2

mradermacher/L3-Inverted-Rainbow-RP-OVA-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 13

mradermacher/IceSakeRP-7b-i1-GGUF

7B • Updated Aug 2, 2024 • 121 • 3

mradermacher/L3-8.9B-Blackfall-SummanusAra-v0.1-i1-GGUF

9B • Updated Dec 16, 2024 • 3 • 1

mradermacher/Vertilake-11B-i1-GGUF

11B • Updated Aug 2, 2024 • 20

utterlygreat/omost-llama-3-8b-IQ4_NL-GGUF

8B • Updated Jul 8, 2024

mradermacher/L3-Scrambled-Eggs-On-Toast-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 76 • 2

Cran-May/internlm2_5-7b-chat-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 8, 2024 • 5

mradermacher/InverseCoder-CL-7B-i1-GGUF

7B • Updated Aug 2, 2024 • 246 • 1

mradermacher/L3-Deluxe-Scrambled-Eggs-On-Toast-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 25 • 2

Cran-May/internlm2_5-7b-chat-IQ4_XS-GGUF

Text Generation • 8B • Updated Jul 8, 2024 • 6

mradermacher/InverseCoder-DS-6.7B-i1-GGUF

7B • Updated Aug 2, 2024 • 165 • 1

mradermacher/L3-Inverted-Rainbow-RP-v2-OVA-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 2

mradermacher/L3-SthenoMaidBlackroot-15B-i1-GGUF

15B • Updated Aug 2, 2024 • 104 • 4

aifeifei798/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 9, 2024 • 1

chrislazar25/qwen-0.5b-gguf

Text Generation • 0.5B • Updated Jul 9, 2024 • 9