Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,093

Full-text search

Active filters: imatrix

duyntnet/OpenHermes-2.5-Mistral-7B-imatrix-GGUF

Text Generation • 7B • Updated May 2, 2024 • 13 • 1

dddump/Japanese-Chat-Evolve-TEST-7B-NSFW-gguf

Text Generation • 7B • Updated May 18, 2024 • 156 • 19

mradermacher/llama-2-16b-nastychat-i1-GGUF

16B • Updated May 5, 2024 • 27 • 1

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated Jun 30, 2024 • 1.86k • 51

mradermacher/Tiamat-8b-1.2-Llama-3-DPO-i1-GGUF

8B • Updated May 5, 2024 • 44

mradermacher/Nous-Puffin-70B-i1-GGUF

69B • Updated May 7, 2024 • 114

mradermacher/Bagel-Hermes-34B-Slerp-i1-GGUF

34B • Updated Jun 26, 2024 • 103

mradermacher/una-xaberius-34b-v1beta-i1-GGUF

34B • Updated May 5, 2024 • 47

bartowski/Llama-3-ChatQA-1.5-8B-GGUF

Text Generation • 8B • Updated May 2, 2024 • 592 • 41

mradermacher/Llama3-Unholy-8B-OAS-i1-GGUF

8B • Updated May 5, 2024 • 13 • 1

lmstudio-community/Meta-Llama-3-8B-Instruct-BPE-fix-GGUF

Text Generation • 8B • Updated May 3, 2024 • 100 • 11

lmstudio-community/Meta-Llama-3-70B-Instruct-BPE-fix-GGUF

Text Generation • 71B • Updated May 3, 2024 • 88 • 4

bartowski/dolphin-2.9-llama3-8b-1m-GGUF

Text Generation • 8B • Updated May 2, 2024 • 108 • 3

backyardai/c4ai-command-r-v01-GGUF

35B • Updated May 22, 2024 • 78

mradermacher/NyakuraV2-34B-Yi-Llama-i1-GGUF

34B • Updated May 5, 2024 • 17

bartowski/Tiamat-8b-1.2-Llama-3-DPO-GGUF

Text Generation • 8B • Updated May 2, 2024 • 114 • 3

mradermacher/Llama3-ChatQA-1.5-8B-i1-GGUF

8B • Updated May 5, 2024 • 282 • 1

mradermacher/Llama-3-Lumimaid-70B-v0.1-i1-GGUF

71B • Updated May 5, 2024 • 55 • 1

dddump/Japanese-TextGen-MoE-TEST-2x7B-NSFW-gguf

Text Generation • 13B • Updated May 18, 2024 • 583 • 27

mradermacher/Llama3-ChatQA-1.5-70B-i1-GGUF

71B • Updated May 5, 2024 • 441 • 10

duyntnet/MagicPrompt-Stable-Diffusion-imatrix-GGUF

Text Generation • 0.2B • Updated May 3, 2024 • 1.01k • 2

duyntnet/FsfairX-Zephyr-Chat-v0.1-imatrix-GGUF

Text Generation • 7B • Updated May 3, 2024 • 15

mradermacher/Llama-3-8B-Instruct-V41-1048k-i1-GGUF

8B • Updated Mar 1, 2025 • 65 • 2

SolidSnacke/Llama-3-Soliloquy-8B-v2-i-GGUF

Text Generation • 8B • Updated May 12, 2024 • 15 • 3

mradermacher/SOVL_Llama3_8B-i1-GGUF

8B • Updated May 5, 2024 • 130

mradermacher/Llama-3-8B-Irene-v0.1-i1-GGUF

8B • Updated May 5, 2024 • 48 • 1

bartowski/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • 71B • Updated May 4, 2024 • 52 • 9

altomek/CodeRosa-70B-AB1-GGUF

69B • Updated Nov 5, 2024 • 18 • 1

mradermacher/Poppy_Porpoise-0.72-L3-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 62 • 5

duyntnet/GritLM-7B-imatrix-GGUF

Text Generation • 7B • Updated May 4, 2024 • 122