Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,796

Base only

Active filters: imatrix

qwp4w3hyb/Yi-1.5-9B-Chat-16K-iMat-GGUF

Text Generation • 9B • Updated May 20, 2024 • 91

bartowski/Yi-1.5-34B-Chat-16K-GGUF

Text Generation • 34B • Updated May 20, 2024 • 1.01k • 6

mradermacher/Deep-Miqu-103B-i1-GGUF

103B • Updated May 24, 2024 • 60 • 1

fluidapp/meta-llama-3-8b-instruct-gguf

8B • Updated Jul 2, 2024 • 30

mradermacher/L3_SnowStorm_4x8B-i1-GGUF

25B • Updated May 24, 2024 • 509 • 4

mradermacher/MAmmoTH2-8x7B-Plus-i1-GGUF

47B • Updated May 24, 2024 • 277

duyntnet/HamSter-0.2-imatrix-GGUF

Text Generation • 7B • Updated May 21, 2024 • 476

mradermacher/MAmmoTH2-8x7B-i1-GGUF

47B • Updated May 24, 2024 • 252

duyntnet/TenyxChat-7B-v1-imatrix-GGUF

Text Generation • 7B • Updated May 21, 2024 • 262

mradermacher/Llama-3-70Bx2-MOE-i1-GGUF

127B • Updated May 24, 2024 • 178 • 1

shing3232/sakura-14b-qwen2beta-v0.9.2-IMX

14B • Updated May 31, 2024 • 70 • 3

qwp4w3hyb/Phi-3-medium-128k-instruct-iMat-GGUF

Text Generation • 14B • Updated May 22, 2024 • 284 • 4

bartowski/Phi-3-medium-4k-instruct-GGUF

Text Generation • 14B • Updated Aug 9, 2024 • 5.28k • 39

bartowski/Phi-3-medium-128k-instruct-GGUF

Text Generation • 14B • Updated Aug 13, 2024 • 4.25k • 61

InferenceIllusionist/Llama3-ChatQA-1.5-8B-iMat-GGUF

8B • Updated May 23, 2024 • 121

duyntnet/Phi-3-medium-4k-instruct-imatrix-GGUF

Text Generation • 14B • Updated May 22, 2024 • 1.26k

mradermacher/HelpingAI-9B-i1-GGUF

9B • Updated Dec 16, 2024 • 574

mradermacher/L3-8B-Stheno-v3.1-i1-GGUF

8B • Updated May 24, 2024 • 224 • 1

mradermacher/FinalFintetuning-XVIII-v1.1-2x8B-i1-GGUF

14B • Updated May 24, 2024 • 224 • 1

hermes42/Phi-3-medium-128k-instruct-imatrix-GGUF

Text Generation • 14B • Updated May 22, 2024 • 1.05k • 1

duyntnet/IceLatteRP-7b-imatrix-GGUF

Text Generation • 7B • Updated May 22, 2024 • 348 • 1

Lewdiculous/rogue-enchantress-32k-7B-GGUF-IQ-Imatrix

7B • Updated May 22, 2024 • 540 • 5

SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

Text Generation • 4B • Updated May 22, 2024 • 23

mmnga/Phi-3-medium-128k-instruct-gguf

14B • Updated May 22, 2024 • 1.19k • 5

duyntnet/Phi-SoSerious-Mini-V1-imatrix-GGUF

Text Generation • 4B • Updated May 22, 2024 • 597 • 2

mradermacher/Smaug-Llama-3-70B-Instruct-abliterated-v3-i1-GGUF

71B • Updated May 24, 2024 • 796 • 5

hermes42/Mistral-7B-Instruct-v0.3-imatrix-GGUF

Text Generation • 7B • Updated May 22, 2024 • 486 • 4

duyntnet/Mistral-7B-Instruct-v0.3-imatrix-GGUF

Text Generation • 7B • Updated May 22, 2024 • 815

qwp4w3hyb/Phi-3-medium-4k-instruct-iMat-GGUF

Text Generation • 14B • Updated May 23, 2024 • 139

mradermacher/llama-3-daybreak-v0.3-70b-hf-i1-GGUF

71B • Updated May 24, 2024 • 60