Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,177

Full-text search

Active filters: imatrix

fluidapp/meta-llama-3-8b-instruct-gguf

8B • Updated Jul 2, 2024

mradermacher/L3_SnowStorm_4x8B-i1-GGUF

25B • Updated May 24, 2024 • 64 • 4

mradermacher/MAmmoTH2-8x7B-Plus-i1-GGUF

47B • Updated May 24, 2024 • 83

duyntnet/HamSter-0.2-imatrix-GGUF

Text Generation • 7B • Updated May 21, 2024

mradermacher/MAmmoTH2-8x7B-i1-GGUF

47B • Updated May 24, 2024 • 24

duyntnet/TenyxChat-7B-v1-imatrix-GGUF

Text Generation • 7B • Updated May 21, 2024 • 1

mradermacher/Llama-3-70Bx2-MOE-i1-GGUF

127B • Updated May 24, 2024 • 79 • 1

shing3232/sakura-14b-qwen2beta-v0.9.2-IMX

14B • Updated May 31, 2024 • 45 • 3

qwp4w3hyb/Phi-3-medium-128k-instruct-iMat-GGUF

Text Generation • 14B • Updated May 22, 2024 • 22 • 4

bartowski/Phi-3-medium-4k-instruct-GGUF

Text Generation • 14B • Updated Aug 9, 2024 • 1.08k • 37

bartowski/Phi-3-medium-128k-instruct-GGUF

Text Generation • 14B • Updated Aug 13, 2024 • 2.96k • 60

InferenceIllusionist/Llama3-ChatQA-1.5-8B-iMat-GGUF

8B • Updated May 23, 2024 • 29

duyntnet/Phi-3-medium-4k-instruct-imatrix-GGUF

Text Generation • 14B • Updated May 22, 2024 • 9

mradermacher/HelpingAI-9B-i1-GGUF

9B • Updated Dec 16, 2024 • 1.88k

mradermacher/L3-8B-Stheno-v3.1-i1-GGUF

8B • Updated May 24, 2024 • 137 • 1

mradermacher/FinalFintetuning-XVIII-v1.1-2x8B-i1-GGUF

14B • Updated May 24, 2024 • 40 • 1

hermes42/Phi-3-medium-128k-instruct-imatrix-GGUF

Text Generation • 14B • Updated May 22, 2024 • 33 • 1

duyntnet/IceLatteRP-7b-imatrix-GGUF

Text Generation • 7B • Updated May 22, 2024 • 4 • 1

Lewdiculous/rogue-enchantress-32k-7B-GGUF-IQ-Imatrix

7B • Updated May 22, 2024 • 57 • 5

SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

Text Generation • 4B • Updated May 22, 2024 • 49

mmnga/Phi-3-medium-128k-instruct-gguf

14B • Updated May 22, 2024 • 163 • 5

duyntnet/Phi-SoSerious-Mini-V1-imatrix-GGUF

Text Generation • 4B • Updated May 22, 2024 • 39 • 2

mradermacher/Smaug-Llama-3-70B-Instruct-abliterated-v3-i1-GGUF

71B • Updated May 24, 2024 • 126 • 5

hermes42/Mistral-7B-Instruct-v0.3-imatrix-GGUF

Text Generation • 7B • Updated May 22, 2024 • 212 • 4

duyntnet/Mistral-7B-Instruct-v0.3-imatrix-GGUF

Text Generation • 7B • Updated May 22, 2024 • 2

qwp4w3hyb/Phi-3-medium-4k-instruct-iMat-GGUF

Text Generation • 14B • Updated May 23, 2024 • 93

mradermacher/llama-3-daybreak-v0.3-70b-hf-i1-GGUF

71B • Updated May 24, 2024

mradermacher/dolphin-2.9.1-llama-3-70b-i1-GGUF

71B • Updated Jul 15, 2025 • 117 • 1

duyntnet/Delexa-Instruct-V0.1-7b-imatrix-GGUF

Text Generation • 7B • Updated May 23, 2024 • 4

qwp4w3hyb/Yi-1.5-34B-Chat-16K-iMat-GGUF

Text Generation • 34B • Updated May 23, 2024 • 33