Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,608

Full-text search

Active filters: imatrix

mradermacher/LongWriter-llama3.1-8b-i1-GGUF

8B • Updated Jul 29, 2025 • 693 • 3

mradermacher/CeleMo-Instruct-128k-i1-GGUF

12B • Updated Aug 15, 2024 • 52 • 1

Reiterate3680/Aura-NeMo-12B-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 3 • 1

mradermacher/Aura32k-i1-GGUF

7B • Updated Aug 15, 2024 • 30 • 1

duyntnet/Meta-Llama-3.1-8B-imatrix-GGUF

Text Generation • 8B • Updated Aug 15, 2024 • 53

mradermacher/Iridium-72B-v0.1-i1-GGUF

73B • Updated Aug 15, 2024 • 37

mradermacher/TypeII-12B-i1-GGUF

12B • Updated Aug 15, 2024 • 33 • 1

mradermacher/Tess-3-Mistral-Nemo-12B-i1-GGUF

12B • Updated Aug 15, 2024 • 180 • 1

mradermacher/guanaco-33b-lxctx-PI-16384-LoRA-fp16-i1-GGUF

33B • Updated Aug 15, 2024 • 95

mradermacher/Wizard-Vicuna-30B-Uncensored-lxctx-PI-16384-LoRA-fp16-i1-GGUF

33B • Updated Aug 15, 2024 • 575

mradermacher/TypeII-A-12B-i1-GGUF

12B • Updated Aug 15, 2024 • 82 • 1

mradermacher/Dracarys-72B-Instruct-i1-GGUF

73B • Updated Aug 16, 2024 • 4

mradermacher/OpenCrystal-Instruct-128k-i1-GGUF

12B • Updated Aug 16, 2024 • 96

DavidAU/Command-R-01-Ultra-NEO-DARK-HORROR-V1-V2-35B-IMATRIX-GGUF

Text Generation • 35B • Updated Jul 28, 2025 • 1.98k • 19

Reiterate3680/MN-12B-Tarsus-GGUF

Text Generation • 12B • Updated Aug 16, 2024 • 1

mradermacher/Roleplay-Hermes-3-Llama-3.1-8B-i1-GGUF

8B • Updated Aug 16, 2024 • 581 • 5

mradermacher/MN-12B-Starcannon-v4-unofficial-i1-GGUF

12B • Updated Aug 16, 2024 • 137 • 1

mradermacher/mistral-nemo-gutenberg-12B-v3-i1-GGUF

12B • Updated Aug 16, 2024 • 102 • 2

Reiterate3680/Rocinante-12B-v1.1-GGUF

Text Generation • 12B • Updated Aug 16, 2024 • 4 • 1

mradermacher/Dracarys-Llama-3.1-70B-Instruct-i1-GGUF

71B • Updated Aug 16, 2024 • 134

mradermacher/Rocinante-12B-v1-i1-GGUF

12B • Updated Aug 16, 2024 • 254 • 2

mradermacher/Hermes-3-Llama-3.1-70B-i1-GGUF

71B • Updated Aug 16, 2024 • 212 • 2

mradermacher/Hermes-3-Llama-3.1-8B-i1-GGUF

8B • Updated Aug 16, 2024 • 293 • 3

mradermacher/TwinLlama-3.1-8B-6-i1-GGUF

8B • Updated Aug 16, 2024 • 71

mradermacher/Rocinante-12B-v1.1-i1-GGUF

12B • Updated Aug 16, 2024 • 652 • 5

mradermacher/TwinLlama-3.1-8B-7-i1-GGUF

8B • Updated Aug 16, 2024 • 40

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • 8B • Updated Aug 16, 2024 • 1.31k • 1

ClaudioItaly/Hermes-3-Llama-3.1-8B-Q5_K_M-GGUF

8B • Updated Aug 16, 2024 • 124 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • 71B • Updated Aug 16, 2024 • 366 • 1

mradermacher/Fireball-Llama-3.11-8B-v1orpo-i1-GGUF

8B • Updated Aug 16, 2024 • 23