Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,900

Full-text search

Active filters: imatrix

jott1970/Llama3-vodka-Q4_K_M-GGUF

8B • Updated Sep 4, 2024 • 1

mradermacher/Fireball-Alpaca-Llama3.1.01-8B-Philos-i1-GGUF

8B • Updated Dec 16, 2024 • 167

mradermacher/SystemAI-7B-i1-GGUF

7B • Updated Sep 4, 2024 • 104 • 1

mradermacher/CelineGPT-12B-v0.1-i1-GGUF

12B • Updated Sep 4, 2024 • 190 • 1

mradermacher/Lama-DPOlphin-8B-i1-GGUF

8B • Updated Sep 4, 2024 • 156 • 1

mradermacher/L3.1-Artemis-c-8B-i1-GGUF

8B • Updated Sep 4, 2024 • 102 • 2

mradermacher/WizardMath-7B-V1.1-i1-GGUF

7B • Updated Sep 4, 2024 • 211

mradermacher/SystemHD-7B-i1-GGUF

7B • Updated Sep 4, 2024 • 65 • 1

mradermacher/TowerInstruct-Mistral-7B-v0.2-i1-GGUF

7B • Updated Sep 4, 2024 • 118

mradermacher/WizardCoder-Python-13B-V1.0-i1-GGUF

13B • Updated Sep 4, 2024 • 165

duyntnet/DeepSeek-Coder-V2-Lite-Instruct-imatrix-GGUF

Text Generation • 16B • Updated Sep 5, 2024 • 20

mradermacher/Fireball-Mistral-Nemo-evol-Instruct-14B-i1-GGUF

12B • Updated Sep 5, 2024 • 127

CISCai/Yi-Coder-9B-Chat-SOTA-GGUF

Text Generation • 9B • Updated Sep 19, 2024 • 94

mradermacher/WizardLM-13B-V1.2-i1-GGUF

13B • Updated Sep 4, 2024 • 64

bunnycore/HyperLlama-3.1-8B-IQ4_NL-GGUF

8B • Updated Sep 4, 2024 • 4 • 1

mradermacher/granite-7b-base-i1-GGUF

7B • Updated Sep 5, 2024 • 129

mradermacher/starcoder2-3b-i1-GGUF

3B • Updated Sep 5, 2024 • 224

mradermacher/OpenCrystal-15B-L3-v3-i1-GGUF

15B • Updated Sep 5, 2024 • 36 • 1

mradermacher/Ph3della-14B-i1-GGUF

14B • Updated Sep 5, 2024 • 92 • 1

mradermacher/falcon-11B-i1-GGUF

11B • Updated Sep 5, 2024 • 177

mradermacher/openchat_3.5-i1-GGUF

7B • Updated Sep 5, 2024 • 153 • 1

mradermacher/New-Dawn-Ultra-Llama-3-70B-32K-v1.0-i1-GGUF

71B • Updated Sep 6, 2024 • 221 • 3

mradermacher/WizardMath-7B-V1.0-i1-GGUF

7B • Updated Sep 5, 2024 • 108

mradermacher/WizardCoder-15B-V1.0-i1-GGUF

16B • Updated Sep 5, 2024 • 172 • 1

mradermacher/SOLAR-0-70b-16bit-i1-GGUF

69B • Updated Sep 6, 2024 • 46

mradermacher/Qwen-72B-Chat-i1-GGUF

72B • Updated Oct 11, 2024 • 77

mradermacher/dolphin-2.2.1-mistral-7b-i1-GGUF

7B • Updated Jul 15, 2025 • 157 • 1

speakleash/Bielik-11B-v2.3-Instruct-GGUF

Text Generation • 11B • Updated Nov 26, 2024 • 4.41k • 27

speakleash/Bielik-11B-v2.0-Instruct-GGUF-IQ-Imatrix

Text Generation • 11B • Updated Sep 10, 2024 • 30 • 1

speakleash/Bielik-11B-v2.1-Instruct-GGUF-IQ-Imatrix

Text Generation • 11B • Updated Sep 10, 2024 • 21 • 1