Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,762

Base only

Active filters: imatrix

qwp4w3hyb/DeepSeek-Coder-V2-Instruct-iMat-GGUF

236B • Updated Jun 28, 2024 • 204 • 2

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

8B • Updated Aug 2, 2024 • 530 • 21

mradermacher/LemonadeRP-4.5.3-i1-GGUF

7B • Updated Aug 2, 2024 • 264 • 1

mradermacher/dolphin-2.2-yi-34b-200k-i1-GGUF

34B • Updated Jul 15, 2025 • 1.02k • 3

backyardai/magnum-72b-v1-GGUF

Text Generation • 73B • Updated Jun 26, 2024 • 240 • 1

Undi95/MG-FinalMix-72B-GGUF

73B • Updated Jun 26, 2024 • 19 • 2

mradermacher/Einstein-v7-Qwen2-7B-i1-GGUF

8B • Updated Aug 2, 2024 • 1.13k

mradermacher/Yi-34B-200K-Llamafied-i1-GGUF

34B • Updated Aug 2, 2024 • 288

mradermacher/Breeze-13B-32k-Instruct-v1_0-i1-GGUF

13B • Updated Aug 2, 2024 • 1.52k

mradermacher/Llama-3-ELYZA-JP-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 343

nalf3in2/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • 8B • Updated Jun 26, 2024 • 10

Trisert/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • 8B • Updated Jun 26, 2024 • 5

mradermacher/Llama-3-neoAI-8B-Chat-v0.1-i1-GGUF

8B • Updated Aug 2, 2024 • 53

mradermacher/Yi-1.5-9B-Chat-16K-i1-GGUF

9B • Updated Dec 12, 2024 • 995

duyntnet/MythoMax-L2-13b-imatrix-GGUF

Text Generation • 13B • Updated Jun 26, 2024 • 838 • 2

mradermacher/UNA-34Beagles-32K-bf16-v1-i1-GGUF

34B • Updated Aug 2, 2024 • 835 • 1

NikolayKozloff/Llama-3-Instruct-8B-SPPO-Iter3-IQ4_NL-GGUF

Text Generation • 8B • Updated Jun 26, 2024 • 2 • 1

mmnga/Llama-3-ELYZA-JP-8B-gguf

8B • Updated Jun 26, 2024 • 827 • 4

mradermacher/Yi-34B-i1-GGUF

34B • Updated Dec 12, 2024 • 289 • 1

mradermacher/Yi-6B-i1-GGUF

6B • Updated Dec 14, 2024 • 591

NikolayKozloff/Llama-3-neoAI-8B-Chat-v0.1-IQ4_NL-GGUF

Text Generation • 8B • Updated Jun 26, 2024 • 1 • 1

mradermacher/IceSakeV6RP-7b-i1-GGUF

7B • Updated Feb 3, 2025 • 1 • 1

mradermacher/Yi-6B-Chat-i1-GGUF

6B • Updated Jan 18, 2025 • 653

mradermacher/Yi-1.5-9B-32K-i1-GGUF

9B • Updated Dec 12, 2024 • 482

mradermacher/LLaMa-3-CursedStock-v2.0-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 49 • 2

mradermacher/IceSakeV4RP-7b-i1-GGUF

7B • Updated Aug 2, 2024 • 5

mradermacher/Yi-1.5-34B-Chat-16K-i1-GGUF

34B • Updated Dec 12, 2024 • 164 • 1

mradermacher/Yi-6B-200K-i1-GGUF

6B • Updated Dec 14, 2024 • 559

mradermacher/Yi-9B-i1-GGUF

9B • Updated Dec 28, 2024 • 386

BenevolenceMessiah/Replete-Coder-Llama3-8B-GGUF

8B • Updated Jun 27, 2024 • 36