Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,238

Full-text search

Active filters: imatrix

mradermacher/Meta-Llama-3-70B-Instruct-abliterated-v3.5-i1-GGUF

71B • Updated Aug 2, 2024 • 102 • 3

legraphista/neo_7b_instruct_v0.1-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 236

mradermacher/IceCaffeLatteRP-7b-i1-GGUF

7B • Updated Aug 2, 2024 • 8

legraphista/neo_7b_sft_v0.1-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 379

duyntnet/Hermes-2-Pro-Llama-3-8B-imatrix-GGUF

Text Generation • 8B • Updated May 31, 2024 • 6

mradermacher/IceMochaccinoRP-7b-i1-GGUF

7B • Updated Aug 2, 2024 • 1

legraphista/neo_7b-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 166

MarsupialAI/Moist-Miqu-70B-v1_iMatrix_GGUF

69B • Updated Jun 1, 2024 • 33 • 2

legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF

Text Generation • 8B • Updated May 31, 2024 • 299 • 1

mradermacher/Silver-Sun-v2-11B-i1-GGUF

11B • Updated Aug 2, 2024

SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF

7B • Updated May 31, 2024 • 7

mradermacher/Poppy_Porpoise-1.0-L3-8B-i1-GGUF

8B • Updated Feb 3, 2025 • 32 • 2

mradermacher/Ursidae-11b-Mini-i1-GGUF

12B • Updated Dec 16, 2024 • 107

backyardai/c4ai-command-r-plus-GGUF

104B • Updated Jun 1, 2024 • 166 • 1

legraphista/Meta-Llama-3-8B-Instruct-abliterated-v3-IMat-GGUF

Text Generation • 8B • Updated Jun 1, 2024 • 481 • 1

mradermacher/L3-daybreak-TheSpice-8b-v0.1.3-i1-GGUF

8B • Updated Aug 2, 2024 • 184 • 3

mradermacher/archangel_sft-kto_llama30b-i1-GGUF

33B • Updated Aug 2, 2024 • 83

legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF

Text Generation • 71B • Updated Jun 1, 2024 • 253 • 2

mradermacher/Fimburs11V3-i1-GGUF

11B • Updated Aug 2, 2024 • 23

mradermacher/Llama-Salad-4x8B-V2-i1-GGUF

25B • Updated Aug 2, 2024 • 96 • 4

legraphista/K2-ckpt_360-IMat-GGUF

Text Generation • 65B • Updated Jun 1, 2024 • 276

mradermacher/Llama-3-Obsidian-i1-GGUF

8B • Updated Aug 2, 2024 • 140

duyntnet/Yarn-Llama-2-7b-128k-imatrix-GGUF

Text Generation • 7B • Updated Jun 1, 2024 • 11

mradermacher/nyun-llama3-60B-i1-GGUF

60B • Updated Dec 16, 2024 • 65 • 1

mradermacher/Codestral-RAG-19B-Pruned-i1-GGUF

19B • Updated Aug 2, 2024 • 260

mradermacher/Codestral-21B-Pruned-i1-GGUF

21B • Updated Aug 2, 2024 • 449

mradermacher/Llama-3-Lumimaid-70B-v0.1-OAS-i1-GGUF

71B • Updated Aug 2, 2024 • 7 • 3

mradermacher/quill-72b-i1-GGUF

73B • Updated Aug 2, 2024 • 28

mradermacher/Psyonic-Cetacean-full-precision-i1-GGUF

20B • Updated Dec 16, 2024 • 334

mradermacher/llama-3-SNAMD-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 53