Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

124

Base only

Active filters: ik_llama.cpp

AlexanderKyng/Mistral-Small-119B-2603-ik-GGUF

Text Generation • 119B • Updated Apr 11 • 34

sokann/GLM-5.1-GGUF-1.673bpw

754B • Updated Apr 12 • 308 • 4

ubergarm/MiniMax-M2.7-GGUF

Text Generation • 229B • Updated Apr 15 • 390 • 21

KeinNiemand/Qwen3.5-122B-A10B-abliterix-IK_GGUF

Text Generation • 122B • Updated Apr 14 • 179 • 2

fanwe/CoPaw-Flash-9B-DataAnalyst-GGUF

ubergarm/Kimi-K2.6-GGUF

Text Generation • 1T • Updated Apr 27 • 584 • 37

RDson/Qwen3.6-27B-IQ4_KS-GGUF

Text Generation • 27B • Updated Apr 23 • 10 • 3

ubergarm/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated 25 days ago • 6.58k • 33

sokann/Qwen3.6-27B-GGUF-5.076bpw

Updated Apr 26 • 36 • 6

sokann/Qwen3.6-27B-GGUF-4.262bpw

Updated Apr 30 • 200 • 4

RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF

Text Generation • 27B • Updated May 2 • 524 • 7

sandeshrajx/Qwen3.6-27B-MTP-Q3_K_S-GGUF

Text Generation • 27B • Updated May 7 • 134 • 1

abovespec/Qwen3.6-35B-A3B-IQ4_K_R4-GGUF

35B • Updated May 7 • 167 • 3

cafkafk/gemma-4-E2B-it-assistant-GGUF-noimatrix

78M • Updated May 8 • 591 • 2

cafkafk/gemma-4-E4B-it-assistant-GGUF-noimatrix

78.8M • Updated May 8 • 817 • 3

cafkafk/gemma-4-26B-A4B-it-assistant-GGUF-noimatrix

0.4B • Updated May 8 • 1.19k • 2

cafkafk/gemma-4-31B-it-assistant-GGUF-noimatrix

0.5B • Updated May 8 • 954 • 8

AlexanderKyng/Qwen3.6-27B-MTP-Custom-IQ6_K

Image-Text-to-Text • 27B • Updated May 12 • 73 • 1

ji-farthing/gemma-4-26B-A4B-it-assistant-Q4_K_S-GGUF

0.4B • Updated May 13 • 211

ji-farthing/gemma-4-26B-A4B-it-assistant-Q6_K-GGUF

0.4B • Updated May 13 • 257 • 1

AlexanderKyng/Qwen3.6-35B-A3B-MTP-Mixed-Q8_0

Image-Text-to-Text • 36B • Updated May 17 • 109

weiweisky/Qwen3.6-27B-GGUF-4.256bpw

Updated May 21 • 18

KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF

Text Generation • 8B • Updated 12 days ago • 4.4k

rafw007/qwen36-a3b-claude-coder-llama.cpp-GGUF

Text Generation • 36B • Updated 22 days ago • 12.9k • 2

ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF

31B • Updated 19 days ago • 515

Radamanthys11/Gemma-4-26B-A4B-it-DFlash-GGUF

Text Generation • 0.4B • Updated 15 days ago • 394

Radamanthys11/Gemma-4-31B-it-DFlash-GGUF

Text Generation • 2B • Updated 15 days ago • 322

Radamanthys11/Qwen3.5-122B-A10B-DFlash-GGUF

Text Generation • 0.5B • Updated 15 days ago • 322 • 1

Radamanthys11/Qwen3.6-35B-A3B-DFlash-GGUF

Text Generation • 0.5B • Updated 15 days ago • 386

Radamanthys11/Qwen3.6-27B-DFlash-GGUF

Text Generation • 2B • Updated 15 days ago • 355