Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27

Base only

Active filters: iq4_xs

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated 8 days ago • 3.35k • 7

Verkiki/Qwen3.8-27b-Fable5-Distill-Abliterated-GGUF

Text Generation • 0.5B • Updated 4 days ago • 2.39k • 2

Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF

Text Generation • 27B • Updated 5 days ago • 714 • 1

Skttttt/Himeros_27B_IQ4XS

Text Generation • 27B • Updated about 22 hours ago • 1

Deaquay/T-Rex-mini-IQ4_XS-GGUF

8B • Updated Apr 9, 2025 • 22

Deaquay/T-Rex-mini-I1-GGUF

8B • Updated Apr 9, 2025 • 78

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 55 • 5

kaushall13/Qwen3.5-9B-GGUF-SBGQ

Text Generation • 9B • Updated Mar 26 • 15

ospost/gpt-oss-20b-sft-GGUF

21B • Updated Apr 1 • 14

dxx117/MiniMax-M2.7-IQ4_XS-HQ-GGUF

Text Generation • 229B • Updated Apr 14 • 9

end000/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 19 • 44 • 1

Krasnopjorovs/Qwen3.6-35B-A3B-IQ4_XS-Imatrix

Text Generation • 35B • Updated Apr 22 • 66 • 1

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 11

localweights/Qwen3.6-27B-MTP-IQ4_XS-GGUF

27B • Updated May 7 • 185 • 5

localweights/Qwen3.6-35B-A3B-MTP-IQ4_XS-GGUF

36B • Updated May 7 • 485 • 4

zaydiscold/Qwopus3.6-27B-v2-IQ4_XS-GGUF

27B • Updated May 23 • 153 • 1

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 83 • 1

KeinNiemand/Kuwutu-7B-CYOA-GGUF

Text Generation • 8B • Updated Jun 17 • 68

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 391 • 1

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 615 • 6

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 194 • 2

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 544 • 4

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 506 • 1

pearsonkyle/Ornith-1.0-9B-imatrix-GGUF

Text Generation • 9B • Updated Jul 11 • 607 • 2

xero0000/Gemma-4-26B-A4B-it-vram14-iq4xs-imat

Text Generation • 25B • Updated Jul 19 • 95 • 1

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated Jul 22 • 1.72k • 13

Hob-forge/Qwen3.5-4B-Instruct-GGUF

Text Generation • 4B • Updated about 11 hours ago • 182