Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: q4-k-m

daksh-neo/acervo-extractor-qwen3.5-9b-GGUF

Text Generation • 9B • Updated Mar 25 • 7 • 1

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 111

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 66

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 361 • 6

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 6.1k • 2

regolo/brick-complexity-extractor-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 13 • 17

regolo/brick-complexity-2-eco-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 5

regolo/brick-complexity-2-max-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 11

helenk/gemma-4-E4B-finetune-GGUF

Text Generation • 7B • Updated May 9 • 343 • 1

helenk/gemma-4-E2B-finetune-GGUF

Text Generation • 5B • Updated May 9 • 61 • 2

josoroma/gemma-4-codigo-trabajo-gguf

Text Generation • 31B • Updated May 10 • 38

originalGeek/Orthrus-Qwen3-8B-GGUF

Text Generation • 10B • Updated Jun 13 • 116

shira-qwq/RUM-F2K-4B-1296000-GGUF

Text-to-Image • 4B • Updated 13 days ago • 161

FerrellSyntheticIntelligence/Phantom-2.5B-v0

Updated 2 days ago • 162