Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,795

Base only

Active filters: imatrix

mradermacher/Maixtchup-4x7b-i1-GGUF

24B • Updated Aug 2, 2024 • 190

mradermacher/llama-3-spicy-abliterated-stella-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 546 • 2

mradermacher/dolphin-2.9.2-mixtral-8x22b-i1-GGUF

141B • Updated Jul 15, 2025 • 248 • 6

mradermacher/Poppy_Porpoise-1.30-L3-8B-i1-GGUF

8B • Updated Feb 3, 2025 • 186 • 2

mradermacher/Llama-3-22B-Instruct-v0.1-i1-GGUF

23B • Updated Aug 2, 2024 • 122

legraphista/K2-IMat-GGUF

Text Generation • 65B • Updated May 31, 2024 • 305 • 3

mradermacher/Meta-Llama-3-70B-Instruct-abliterated-v3.5-i1-GGUF

71B • Updated Aug 2, 2024 • 1.06k • 3

legraphista/neo_7b_instruct_v0.1-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 1.24k

mradermacher/IceCaffeLatteRP-7b-i1-GGUF

7B • Updated Aug 2, 2024 • 76

legraphista/neo_7b_sft_v0.1-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 566

duyntnet/Hermes-2-Pro-Llama-3-8B-imatrix-GGUF

Text Generation • 8B • Updated May 31, 2024 • 855

mradermacher/IceMochaccinoRP-7b-i1-GGUF

7B • Updated Aug 2, 2024 • 79

legraphista/neo_7b-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 907

MarsupialAI/Moist-Miqu-70B-v1_iMatrix_GGUF

69B • Updated Jun 1, 2024 • 335 • 2

legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 1.52k • 1

mradermacher/Silver-Sun-v2-11B-i1-GGUF

11B • Updated Aug 2, 2024 • 49

SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF

7B • Updated May 31, 2024 • 27

mradermacher/Poppy_Porpoise-1.0-L3-8B-i1-GGUF

8B • Updated Feb 3, 2025 • 124 • 2

hermes42/WizardLM-2-8x22B-imatrix-GGUF

141B • Updated Jun 1, 2024 • 1.02k • 1

mradermacher/Ursidae-11b-Mini-i1-GGUF

12B • Updated Dec 16, 2024 • 888

bartowski/AutoCoder-GGUF

Text Generation • 33B • Updated May 31, 2024 • 1.07k • 7

backyardai/c4ai-command-r-plus-GGUF

104B • Updated Jun 1, 2024 • 184 • 1

legraphista/Meta-Llama-3-8B-Instruct-abliterated-v3-IMat-GGUF

Text Generation • 8B • Updated Jun 1, 2024 • 1.91k • 1

mradermacher/L3-daybreak-TheSpice-8b-v0.1.3-i1-GGUF

8B • Updated Aug 2, 2024 • 99 • 3

mradermacher/archangel_sft-kto_llama30b-i1-GGUF

33B • Updated Aug 2, 2024 • 2.81k

legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF

Text Generation • 71B • Updated Jun 1, 2024 • 2.14k • 2

mradermacher/Fimburs11V3-i1-GGUF

11B • Updated Aug 2, 2024 • 345

mradermacher/Llama-Salad-4x8B-V2-i1-GGUF

25B • Updated Aug 2, 2024 • 74 • 4

legraphista/K2-ckpt_360-IMat-GGUF

Text Generation • 65B • Updated Jun 1, 2024 • 1.69k

bartowski/K2-Chat-GGUF

Text Generation • 65B • Updated Jun 1, 2024 • 1.59k • 5