Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,200

Full-text search

Active filters: imatrix

legraphista/Llama-3-Instruct-8B-SimPO-IMat-GGUF

Text Generation • 8B • Updated May 28, 2024 • 333 • 1

Lewdiculous/Halu-8B-Llama3-Blackroot-GGUF-IQ-Imatrix

8B • Updated May 28, 2024 • 79 • 7

duyntnet/Mistral-7B-Holodeck-1-imatrix-GGUF

Text Generation • 7B • Updated May 28, 2024 • 2

mradermacher/SOVLish-Devil-8B-L3-i1-GGUF

8B • Updated Aug 2, 2024 • 29

mradermacher/Neural-SOVLish-Devil-8B-L3-i1-GGUF

8B • Updated Aug 2, 2024 • 118

Lewdiculous/Neural-SOVLish-Devil-8B-L3-GGUF-IQ-Imatrix

8B • Updated May 29, 2024 • 28 • 6

dphn/dolphin-2.9.2-qwen2-72b-gguf

73B • Updated May 29, 2024 • 700 • 19

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix

Text Generation • 20B • Updated Jul 28, 2025 • 728 • 14

mradermacher/Halu-8B-Llama3-Blackroot-i1-GGUF

8B • Updated Aug 2, 2024 • 6 • 2

mradermacher/CabraCommand-r-v01-16k-i1-GGUF

35B • Updated Jul 17, 2025 • 2.52k

mradermacher/REBEL-OpenChat-3.5-i1-GGUF

7B • Updated Aug 2, 2024 • 46

mradermacher/LuminRP-13B-128k-v0.5-i1-GGUF

12B • Updated Aug 2, 2024 • 35 • 1

mradermacher/ReflectionCoder-CL-34B-i1-GGUF

34B • Updated Aug 2, 2024 • 248

qwp4w3hyb/openchat-3.6-8b-20240522-iMat-GGUF

Text Generation • 8B • Updated May 29, 2024 • 16

mradermacher/Llama-3-70b-Arimas-story-RP-V1.5-i1-GGUF

71B • Updated Aug 2, 2024 • 115 • 3

mradermacher/Mahou-1.3-llama3-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 195 • 1

mradermacher/ReflectionCoder-DS-6.7B-i1-GGUF

7B • Updated Aug 2, 2024 • 35 • 1

mradermacher/ReflectionCoder-CL-7B-i1-GGUF

7B • Updated Aug 2, 2024 • 96

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

7B • Updated May 29, 2024 • 498 • 8

mmnga/ArrowPro-7B-KillerWhale-gguf

7B • Updated May 29, 2024 • 65 • 1

mradermacher/quill-7b-i1-GGUF

8B • Updated Aug 2, 2024 • 37 • 1

bartowski/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 5, 2024 • 2.64k • 193

duyntnet/DocsGPT-7B-imatrix-GGUF

Text Generation • 7B • Updated May 29, 2024 • 2

legraphista/Codestral-22B-v0.1-IMat-GGUF

Text Generation • 22B • Updated May 30, 2024 • 250 • 13

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 1, 2024 • 162 • 9

lmstudio-community/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 5, 2024 • 7.99k • 28

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

8B • Updated Dec 12, 2024 • 206 • 22

mradermacher/dolphin-2.9.1-dbrx-llamacppfixed-i1-GGUF

132B • Updated Aug 2, 2024 • 3

mradermacher/quill-72b-instruct-i1-GGUF

73B • Updated Aug 2, 2024 • 55 • 4

mradermacher/Mahou-1.3-mistral-7B-i1-GGUF

7B • Updated Aug 2, 2024 • 69 • 1