Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,101

Full-text search

Active filters: imatrix

MarsupialAI/Cat-Llama-3-70B-instruct_iMatrix_GGUF

71B • Updated May 7, 2024 • 25

mradermacher/Tess-2.0-Llama-3-70B-v0.2-i1-GGUF

71B • Updated May 7, 2024 • 93

mmnga/lightblue-suzume-llama-3-8B-multilingual-gguf

8B • Updated May 7, 2024 • 289 • 1

mradermacher/Coomand-R-35B-v1-i1-GGUF

35B • Updated Dec 16, 2024 • 35 • 2

mradermacher/JSL-MedLX-70B-v3-i1-GGUF

71B • Updated May 7, 2024 • 3

mradermacher/Cat-Llama-3-70B-instruct-i1-GGUF

71B • Updated May 7, 2024 • 286 • 10

mradermacher/Palmyra-Med-70B-i1-GGUF

71B • Updated Sep 20, 2024 • 425 • 1

mmnga/lightblue-Karasu-Mixtral-8x22B-v0.1-gguf

141B • Updated May 7, 2024 • 21

mradermacher/Merge-Mayhem-L3-V2-i1-GGUF

8B • Updated Apr 20, 2025 • 76

mradermacher/Code-Llama-3-8B-i1-GGUF

8B • Updated May 8, 2024 • 229 • 1

mradermacher/Roleplay-Llama-3-8B-i1-GGUF

8B • Updated May 8, 2024 • 105 • 1

mradermacher/Llama-3-Galen-70B-v1-i1-GGUF

71B • Updated May 10, 2024 • 46

mradermacher/SynthIA-70B-v1.5-i1-GGUF

69B • Updated May 10, 2024 • 1

bartowski/llama-3-neural-chat-v2.2-8B-GGUF

Text Generation • 8B • Updated May 8, 2024 • 52 • 5

mradermacher/l3-badger-mushroom-4x8b-i1-GGUF

25B • Updated May 10, 2024 • 64

cgus/NinjaMouse2-2.5B-v0.1-iMat-GGUF

3B • Updated May 9, 2024 • 47 • 1

mmnga/karakuri-lm-8x7b-chat-v0.1-gguf

47B • Updated May 8, 2024 • 51 • 4

Clevyby/Poppy-Porpoise-0.72-L3-8B-Q5_K_S-GGUF-iMatrix

Text Generation • 8B • Updated May 8, 2024 • 22 • 1

Clevyby/Lumimaid-8B-v0.1-OAS-Q5_K_S-GGUF-iMatrix

Text Generation • 8B • Updated May 8, 2024 • 16 • 1

qwp4w3hyb/Llama-3-8B-Instruct-Coder-v2-iMat-GGUF

8B • Updated May 11, 2024 • 14 • 1

mradermacher/Llama-3-8B-Irene-v0.2-i1-GGUF

8B • Updated May 10, 2024 • 209 • 1

mradermacher/Lumina-5.5-Instruct-i1-GGUF

32B • Updated May 10, 2024 • 107

mradermacher/Llama-3-Aplite-Instruct-4x8B-i1-GGUF

25B • Updated Dec 16, 2024 • 83

bartowski/Llama-3-11.5B-Instruct-Coder-v2-GGUF

Text Generation • 12B • Updated May 8, 2024 • 119 • 7

bartowski/Meta-Llama-3-120B-Instruct-GGUF

Text Generation • 122B • Updated May 9, 2024 • 106 • 4

lmstudio-community/Meta-Llama-3-120B-Instruct-GGUF

Text Generation • 122B • Updated May 9, 2024 • 214 • 48

duyntnet/NexusRaven-V2-13B-imatrix-GGUF

Text Generation • 13B • Updated May 9, 2024 • 99 • 2

mradermacher/MELT-llama-2-3x70b-chat-hf-i1-GGUF

182B • Updated May 16, 2024 • 17

mradermacher/Euryale-1.3-Small-7B-i1-GGUF

7B • Updated May 10, 2024 • 116

mmnga/DataPilot-ArrowPro-7B-KUJIRA-gguf

7B • Updated May 11, 2024 • 322 • 10