Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,172

Full-text search

Active filters: imatrix

duyntnet/neural-chat-7b-v3-3-imatrix-GGUF

Text Generation • 7B • Updated May 18, 2024 • 48

duyntnet/Percival_01-7b-slerp-imatrix-GGUF

Text Generation • 7B • Updated May 18, 2024 • 8

mradermacher/Dusk-Miqu-70B-i1-GGUF

69B • Updated May 19, 2024 • 99 • 1

backyardai/Dark-Miqu-70B-GGUF

69B • Updated May 22, 2024 • 100

mmnga/aixsatoshi-Honyaku-13b-gguf

13B • Updated May 19, 2024 • 158 • 1

duyntnet/Fimbulvetr-11B-v2-imatrix-GGUF

Text Generation • 11B • Updated May 19, 2024 • 83

mradermacher/LemonKunoichiWizardV3-i1-GGUF

7B • Updated May 19, 2024 • 104 • 1

mradermacher/Master-Yi-9B-i1-GGUF

9B • Updated May 19, 2024 • 97

mradermacher/Chaifighter-20B-v2-i1-GGUF

19B • Updated May 19, 2024 • 103 • 2

mradermacher/dolphin-2.9.1-yi-1.5-9b-i1-GGUF

9B • Updated Jul 15, 2025 • 74 • 2

mradermacher/dolphin-2.9.1-yi-1.5-34b-i1-GGUF

34B • Updated Jul 15, 2025 • 207 • 6

duyntnet/Antler-7B-evolve-imatrix-GGUF

Text Generation • 7B • Updated May 19, 2024 • 55

mradermacher/Smaug-Llama-3-70B-Instruct-i1-GGUF

71B • Updated May 20, 2024 • 175 • 8

mradermacher/Mahou-1.2a-mistral-7B-i1-GGUF

7B • Updated May 19, 2024 • 99 • 1

duyntnet/WizardLM-13B-Uncensored-imatrix-GGUF

Text Generation • 13B • Updated May 20, 2024 • 65 • 5

bartowski/Smaug-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated May 27, 2024 • 42 • 11

Quant-Cartel/Dusk-Miqu-70B-iMat-GGUF

69B • Updated May 21, 2024 • 26

mradermacher/Ninja-v1-NSFW-RP-i1-GGUF

7B • Updated Dec 16, 2024 • 2.48k • 2

mradermacher/Smaug-Llama-3-70B-Instruct-ExPO-i1-GGUF

71B • Updated May 20, 2024 • 32 • 1

bartowski/granite-34b-code-instruct-GGUF

Text Generation • 34B • Updated May 20, 2024 • 223 • 8

duyntnet/Azzurro-imatrix-GGUF

Text Generation • 7B • Updated May 20, 2024

duyntnet/Writing_Partner_Mistral_7B-imatrix-GGUF

Text Generation • 7B • Updated May 20, 2024 • 1

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

8B • Updated Sep 3, 2024 • 1k • 94

ukung/Yi-1.5-9B-Chat-GGUF

9B • Updated May 20, 2024

bartowski/dolphin-2.9.1-yi-1.5-34b-GGUF

Text Generation • 34B • Updated May 20, 2024 • 49 • 5

qwp4w3hyb/Yi-1.5-9B-Chat-16K-iMat-GGUF

Text Generation • 9B • Updated May 20, 2024 • 7

bartowski/Yi-1.5-34B-Chat-16K-GGUF

Text Generation • 34B • Updated May 20, 2024 • 28 • 6

mradermacher/Deep-Miqu-103B-i1-GGUF

103B • Updated May 24, 2024 • 5 • 1

fluidapp/meta-llama-3-8b-instruct-gguf

8B • Updated Jul 2, 2024

mradermacher/L3_SnowStorm_4x8B-i1-GGUF

25B • Updated May 24, 2024 • 64 • 4