Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26

Base only

Active filters: q4-k-m

Jiunsong/SuperQwen3.8-27b-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 8.33k • 23

daksh-neo/acervo-extractor-qwen3.5-9b-GGUF

Text Generation • 9B • Updated Mar 25 • 39 • 1

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 122 • 1

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 38

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 480 • 6

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 762 • 2

regolo/brick-complexity-extractor-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 13 • 4

regolo/brick-complexity-2-eco-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 35 • 1

regolo/brick-complexity-2-max-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 38 • 1

helenk/gemma-4-E4B-finetune-GGUF

Text Generation • 7B • Updated May 9 • 60 • 1

helenk/gemma-4-E2B-finetune-GGUF

Text Generation • 5B • Updated May 9 • 10 • 2

josoroma/gemma-4-codigo-trabajo-gguf

Text Generation • 31B • Updated May 10 • 16

originalGeek/Orthrus-Qwen3-8B-GGUF

Text Generation • 10B • Updated Jun 13 • 22

shira-qwq/RUM-F2K-4B-1296000-GGUF

Text-to-Image • 4B • Updated Jul 1 • 23

shibatch/tinygemma3-2m

Text Generation • 1.56M • Updated 18 days ago • 26

coolthor/Laguna-S-2.1-attnQ8-DFlash-Q4-GGUF

Text Generation • 118B • Updated Jul 22 • 181 • 3

coolthor/Sulphur-2-distilled-Q4_K_M-GGUF

Text-to-Video • 21B • Updated Jul 22 • 5.07k • 2

empgces/gemma3-270m-grounded-behavior-finetuned-v9-GGUF

Text Generation • 0.3B • Updated Jul 28 • 151

FrontisAI/Frontis-MA1-30B-GGUF

Text Generation • 31B • Updated about 1 month ago • 159 • 2

FrontisAI/Frontis-MA1-35B-GGUF

Image-Text-to-Text • 35B • Updated about 1 month ago • 4.09k • 7

Tidalluna/DeepSeek-V4-Flash-0731-Tina-CQ4KM

Text Generation • Updated 28 days ago • 317 • 1

tahsinahsen/birag-gemma4-e2b-response-only-gguf

Text Generation • 5B • Updated 26 days ago • 231 • 1

stenml/BowLingual-12B-v1-GGUF

Text Generation • 12B • Updated 24 days ago • 112

NANI-Nithin/Muse-Glimmer-30B-GGUF

Image-Text-to-Text • 28B • Updated 20 days ago • 4.12k • 4

steven0226/qwen3vl-8b-chartqa-gguf

Image-Text-to-Text • 8B • Updated 17 days ago • 189

shafire/OpenZero-Ouroboros-3.8B-GGUF

Text Generation • 4B • Updated 12 days ago • 401 • 2