Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,603

Full-text search

Active filters: imatrix

nisten/meta-405b-base-gguf

406B • Updated Aug 19, 2024 • 2

nisten/hermes3-405b-gguf

406B • Updated Aug 19, 2024 • 2

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Sep 17, 2024 • 7

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF

Text Generation • 8B • Updated Aug 18, 2024 • 17

duyntnet/flammen21X-mistral-7B-imatrix-GGUF

Text Generation • 7B • Updated Aug 18, 2024 • 48 • 1

mradermacher/Mahou-1.3-llama3.1-8B-i1-GGUF

8B • Updated Mar 31, 2025 • 207 • 1

mradermacher/omed-llama3-8b-i1-GGUF

8B • Updated Sep 8, 2024 • 66 • 1

mradermacher/MN-12b-Sunrose-i1-GGUF

12B • Updated Aug 18, 2024 • 110 • 3

mradermacher/Swallow-MS-7b-v0.1-i1-GGUF

7B • Updated Aug 18, 2024 • 97 • 1

mradermacher/Chocolatine-14B-Instruct-DPO-v1.2-i1-GGUF

14B • Updated Aug 18, 2024 • 400 • 3

mradermacher/Carasique-v0.3a-i1-GGUF

12B • Updated Aug 18, 2024 • 85 • 1

mradermacher/Mistral-Scary-Story-Finetune-i1-GGUF

7B • Updated Aug 18, 2024 • 54

mradermacher/Dolus-14b-Mini-i1-GGUF

12B • Updated Aug 18, 2024 • 58 • 1

mradermacher/Fireball-MathCoder-Llama-3.1-8B-v1dpo-16bit-i1-GGUF

8B • Updated Aug 18, 2024 • 70

mradermacher/Mahou-Gutenberg-Nemo-12B-i1-GGUF

12B • Updated Aug 18, 2024 • 160 • 2

mradermacher/Carasique-v0.3b-i1-GGUF

12B • Updated Aug 18, 2024 • 42 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • 2B • Updated Aug 18, 2024 • 126 • 7

mradermacher/Magnum-Instruct-DPO-12B-i1-GGUF

12B • Updated Aug 18, 2024 • 64 • 1

mradermacher/Swallow-MX-8x7b-NVE-v0.1-i1-GGUF

47B • Updated Aug 18, 2024 • 162

Trisert/Meta-Llama-3.1-8B-Instruct-abliterated-IQ4_NL-GGUF

8B • Updated Aug 18, 2024 • 5

Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 18, 2024 • 6 • 1

anthracite-org/magnum-v2-123b-gguf

Text Generation • 123B • Updated Aug 22, 2024 • 118 • 14

mradermacher/L3.1-70b-Inori-i1-GGUF

71B • Updated Aug 19, 2024 • 119 • 1

mradermacher/Fireball-Llama-3.1-8B-Instruct-v1-16bit-i1-GGUF

8B • Updated Aug 19, 2024 • 56

mradermacher/MN-12B-Starcannon-v5-unofficial-i1-GGUF

12B • Updated Aug 19, 2024 • 59 • 1

mradermacher/Samantha-hermes3-8b-model-fixed-i1-GGUF

8B • Updated Aug 19, 2024 • 33 • 1

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_S-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 3

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 7

Reiterate3680/AuraFinal12B-GGUF

Text Generation • 12B • Updated Aug 19, 2024 • 20 • 1

OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 2