Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16

Base only

Active filters: w4g128

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 1.44M • 132

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 800 • 5

shieldstar/Qwen3.5-122B-A10B-int4-AutoRound-EC

Image-Text-to-Text • 21B • Updated Apr 13 • 8.93k • 7

shieldstar/Qwen3.6-35B-A3B-int4-AutoRound-EC

Image-Text-to-Text • 6B • Updated Apr 23 • 8.24k • 7

abhinand/Qwen3.6-35B-A3B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 27 • 243

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 1.01k • 10

d3dx9/Qwen3.6-27B-Heretic2-Uncensored-Finetune-Thinking-int4-autoround

Text Generation • Updated May 6

webhie/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated May 12 • 2.49k • 1

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 11.7k • 20

ForeverBlue/Qwen3-VL-2B-GRACE-W4G128

Image-Text-to-Text • 2B • Updated 4 days ago • 25 • 1

j3st3r666/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated May 26 • 16

ForeverBlue/LLaVA-1.5-7B-GRACE-W4G128

Image-Text-to-Text • 7B • Updated Jun 3 • 13 • 1

ForeverBlue/LLaVA-1.5-7B-GRACE-W4G128-AWQ

Image-Text-to-Text • 1B • Updated 5 days ago • 13 • 1

WaveCut/Qwopus3.6-27B-Coder-FP8-int4-AutoRound

Image-Text-to-Text • 6B • Updated Jun 14 • 12 • 1

ForeverBlue/Qwen3-VL-2B-GRACE-W4G128-AWQ

Image-Text-to-Text • 0.9B • Updated 4 days ago • 29 • 1

poma-ai/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Jul 2 • 332