Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,842

Base only

Active filters: imatrix

mradermacher/Berghof-ERP-7B-i1-GGUF

7B • Updated Dec 25, 2024 • 225 • 2

tannedbum/L3-Nymeria-Maid-8B-iGGUF

8B • Updated Aug 3, 2024 • 25 • 4

duyntnet/starcoder2-7b-imatrix-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 60

Cran-May/openbuddy-yi1.5-9b-v21.1-32k-Q4_K_S-GGUF

Text Generation • 9B • Updated Jun 22, 2024 • 15

mradermacher/Code-Llama-Bagel-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 595 • 1

mradermacher/Hathor_Unstable-L3-8B-v0.3-i1-GGUF

8B • Updated Dec 16, 2024 • 2.53k • 1

mradermacher/Hathor_Enigmatica-L3-8B-v0.4-i1-GGUF

8B • Updated Dec 16, 2024 • 316 • 1

mradermacher/L3-Evil-Stheno-v3.2-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 95 • 1

mradermacher/jackie-2.0-full-i1-GGUF

8B • Updated Aug 2, 2024 • 62

bartowski/firefunction-v2-GGUF

Text Generation • 71B • Updated Jun 22, 2024 • 522 • 6

grapevine-AI/c4ai-command-r-plus-gguf

104B • Updated Oct 13, 2024 • 147 • 7

ABX-AI/Hathor_Fractionate-L3-8B-v.05-GGUF-IQ-Imat

8B • Updated Jun 23, 2024 • 43 • 2

mradermacher/LLAMA-3_8B_Unaligned_Alpha-i1-GGUF

8B • Updated Aug 2, 2024 • 465

mradermacher/Tinybra_13B-i1-GGUF

13B • Updated Aug 2, 2024 • 936 • 4

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

33B • Updated Mar 10, 2025 • 2.55k • 3

mradermacher/Hathor_Stable-L3-8B-v0.5-i1-GGUF

8B • Updated Mar 21 • 1.26k • 1

mradermacher/YamWizard28-7B-i1-GGUF

7B • Updated Aug 2, 2024 • 192

mradermacher/L3-Elpis-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 63

mradermacher/SMaid-v0.3-i1-GGUF

8B • Updated Aug 2, 2024 • 213

mradermacher/L3-8B-Stheno-v3.3-32K-i1-GGUF

8B • Updated Aug 2, 2024 • 420 • 3

mradermacher/L3-Nymeria-Maid-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 119 • 2

mradermacher/LCARS_AI_1x4_001_SuperAI-i1-GGUF

24B • Updated Aug 2, 2024 • 92

mradermacher/L3-8B-SMaid-v0.3-i1-GGUF

8B • Updated Aug 2, 2024 • 75

mradermacher/L3-8B-SMaid-v0.1-i1-GGUF

8B • Updated Aug 2, 2024 • 392

duyntnet/Codestral-22B-v0.1-imatrix-GGUF

Text Generation • 22B • Updated Jun 23, 2024 • 429 • 1

mradermacher/LLAMA-3_8B_Unaligned_Alpha_RP_Soup-i1-GGUF

8B • Updated Aug 2, 2024 • 158 • 1

Felladrin/gguf-sharded-Qwen1.5-0.5B-Chat_llamafy

0.6B • Updated Aug 8, 2024 • 79

mradermacher/huskylm-2.5-8b-i1-GGUF

8B • Updated Aug 2, 2024 • 780

mradermacher/L3-Inca-8B-v0.8-i1-GGUF

8B • Updated Aug 2, 2024 • 115

mradermacher/New-Dawn-Llama-3-70B-32K-v1.0-i1-GGUF

71B • Updated Aug 2, 2024 • 276 • 10