Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,780

Base only

Active filters: imatrix

legraphista/AutoCoder_S_6.7B-IMat-GGUF

Text Generation • 7B • Updated May 28, 2024 • 951 • 1

legraphista/AutoCoder-IMat-GGUF

Text Generation • 33B • Updated May 28, 2024 • 573 • 1

bartowski/UNA-ThePitbull-21.4B-v2-GGUF

Text Generation • 21B • Updated May 30, 2024 • 967 • 9

legraphista/Llama-3-Instruct-8B-SimPO-IMat-GGUF

Text Generation • 8B • Updated May 28, 2024 • 825 • 1

Lewdiculous/Halu-8B-Llama3-Blackroot-GGUF-IQ-Imatrix

8B • Updated May 28, 2024 • 162 • 7

duyntnet/Mistral-7B-Holodeck-1-imatrix-GGUF

Text Generation • 7B • Updated May 28, 2024 • 1.29k

mradermacher/SOVLish-Devil-8B-L3-i1-GGUF

8B • Updated Aug 2, 2024 • 573

mradermacher/Neural-SOVLish-Devil-8B-L3-i1-GGUF

8B • Updated Aug 2, 2024 • 1.01k

Lewdiculous/Neural-SOVLish-Devil-8B-L3-GGUF-IQ-Imatrix

8B • Updated May 29, 2024 • 269 • 6

dphn/dolphin-2.9.2-qwen2-72b-gguf

73B • Updated May 29, 2024 • 740 • 19

mradermacher/Halu-8B-Llama3-Blackroot-i1-GGUF

8B • Updated Aug 2, 2024 • 103 • 2

mradermacher/CabraCommand-r-v01-16k-i1-GGUF

35B • Updated Jul 17, 2025 • 185

mradermacher/REBEL-OpenChat-3.5-i1-GGUF

7B • Updated Aug 2, 2024 • 1.05k

mradermacher/LuminRP-13B-128k-v0.5-i1-GGUF

12B • Updated Aug 2, 2024 • 120 • 1

mradermacher/ReflectionCoder-CL-34B-i1-GGUF

34B • Updated Aug 2, 2024 • 1.59k

qwp4w3hyb/openchat-3.6-8b-20240522-iMat-GGUF

Text Generation • 8B • Updated May 29, 2024 • 252

mradermacher/Llama-3-70b-Arimas-story-RP-V1.5-i1-GGUF

71B • Updated Aug 2, 2024 • 758 • 3

mradermacher/Mahou-1.3-llama3-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 1.02k • 1

mradermacher/ReflectionCoder-DS-6.7B-i1-GGUF

7B • Updated Aug 2, 2024 • 860 • 1

mradermacher/ReflectionCoder-CL-7B-i1-GGUF

7B • Updated Aug 2, 2024 • 169

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

7B • Updated May 29, 2024 • 3.19k • 9

mmnga/ArrowPro-7B-KillerWhale-gguf

7B • Updated May 29, 2024 • 2.15k • 1

mradermacher/quill-7b-i1-GGUF

8B • Updated Aug 2, 2024 • 68 • 1

duyntnet/DocsGPT-7B-imatrix-GGUF

Text Generation • 7B • Updated May 29, 2024 • 713

legraphista/Codestral-22B-v0.1-IMat-GGUF

Text Generation • 22B • Updated May 30, 2024 • 2.75k • 13

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 1, 2024 • 2.26k • 9

lmstudio-community/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 5, 2024 • 12.1k • 29

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

8B • Updated Dec 12, 2024 • 741 • 22

mradermacher/dolphin-2.9.1-dbrx-llamacppfixed-i1-GGUF

132B • Updated Aug 2, 2024 • 31 • 3

mradermacher/quill-72b-instruct-i1-GGUF

73B • Updated Aug 2, 2024 • 310 • 4