Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,677

Full-text search

Active filters: imatrix

mradermacher/Rude-Assistant-Mistral-Nemo-2407-SFT-i1-GGUF

12B • Updated Jan 22, 2025 • 387 • 2

mradermacher/MN-12B-Celeste-V1.9-i1-GGUF

12B • Updated Aug 1, 2024 • 242 • 4

mradermacher/LumiHathor-i1-GGUF

8B • Updated Aug 1, 2024 • 94 • 1

mradermacher/Yamase-12B-i1-GGUF

12B • Updated Aug 1, 2024 • 187 • 1

mradermacher/llama3-8b-cpt-sea-lionv2-instruct-i1-GGUF

8B • Updated Apr 14, 2025 • 100 • 1

mradermacher/calme-2.2-qwen2-72b-i1-GGUF

73B • Updated Sep 8, 2024 • 33

polyverse/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 1

mradermacher/shieldgemma-9b-i1-GGUF

9B • Updated Aug 1, 2024 • 707 • 1

polyverse/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024

polyverse/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024

polyverse/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 9

polyverse/gemma-2-2b-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 8

polyverse/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 3

polyverse/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 1, 2024 • 4

polyverse/falcon-7b-Q4_K_M-GGUF

7B • Updated Aug 1, 2024 • 2 • 1

backyardai/Bionic-Cetacean-20B-GGUF

20B • Updated Aug 1, 2024 • 117 • 2

YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja-prompt

8B • Updated Aug 1, 2024 • 349 • 1

fluidapp/meta-llama-3.1-8b-instruct-gguf

8B • Updated Aug 1, 2024 • 691

mradermacher/Evolved-Mistral-7B-i1-GGUF

7B • Updated Aug 1, 2024 • 73 • 1

qnixsynapse/Gemma-V2-2B-Instruct-GGUF

Text Generation • 3B • Updated Aug 13, 2024 • 32

mradermacher/Bionic-Cetacean-20B-i1-GGUF

20B • Updated Aug 1, 2024 • 278 • 2

mradermacher/juanako-7b-UNA-i1-GGUF

7B • Updated Aug 1, 2024 • 127

adrlau/noredu-it-Q4_K_M-GGUF

8B • Updated Aug 1, 2024

mradermacher/Llama-3.1-Techne-RP-8b-v1-i1-GGUF

8B • Updated Aug 1, 2024 • 6 • 1

mradermacher/Llama-3.1-SauerkrautLM-70b-Instruct-i1-GGUF

71B • Updated Aug 2, 2024 • 193 • 1

mradermacher/Meltemi-7B-Instruct-v1-i1-GGUF

7B • Updated Aug 1, 2024 • 490

Vdr1/nemo-sunfall-v0.6.1-GGUF-IQ

12B • Updated Aug 2, 2024 • 39 • 3

mradermacher/shieldgemma-27b-i1-GGUF

27B • Updated Aug 1, 2024 • 2.22k

mmnga/gemma-2-2b-it-gguf

3B • Updated Aug 1, 2024 • 1.97k • 1

mmnga/HODACHI-EZO-Common-T2-2B-gemma-2-it-gguf

3B • Updated Aug 1, 2024 • 319 • 5