Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,436

Base only

Active filters: auto-round

LeaderboardModel1/Ornith-1.0-9B-Uncensored-AutoRound-W4A16-RTN

Text Generation • 2B • Updated Jul 13 • 64

weiweiz1/gemma-4-31B-it-ar-best

6B • Updated Jul 13 • 6

LeaderboardModel1/ThinkingCap-Qwen3.6-27B-AutoRound-W4A16-Tuning

Text Generation • 3B • Updated Jul 13 • 1.34k • 3

LeaderboardModel1/Qwen3-1.7B-AutoRound-W4A16-RTN

Text Generation • 0.5B • Updated 29 days ago • 60

LeaderboardModel1/Tess-4-27B-AutoRound-W4A16-Tuning

Text Generation • 11B • Updated Jul 27 • 104

LeaderboardModel1/Qwen3.5-35B-A3B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 13 • 31

c-bf/GLM-5.2-AutoRound-W4G64-MTP

Text Generation • 122B • Updated Jul 14 • 98 • 1

LeaderboardModel1/Qwythos-9B-v2-AutoRound-W4A16-Tuning

Text Generation • 2B • Updated Jul 14 • 82

Intel/gemma-4-31B-it-int4-AutoRound-V2

6B • Updated Jul 15 • 2.01k • 1

weiweiz1/gemma-4-26B-A4B-it-w4g128

3B • Updated Jul 15 • 6

weiweiz1/Qwen3.6-35B-A3B-w4g128

4B • Updated Jul 15 • 6

JBrightmanAI/GLM-5.2-504B-W4A16

Text Generation • 68B • Updated Jul 16 • 125 • 2

LeaderboardModel1/Tess-4-9B-AutoRound-W4A16-Tuning

Text Generation • 2B • Updated Jul 17 • 85

LeaderboardModel1/Nex-N2-mini-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jul 17 • 1.09k

LeaderboardModel1/MagiSeek-Pro-V1-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jul 17 • 57

azampatti/Ornith-1.0-35B-int4-AutoRound-SAR

Text Generation • 1B • Updated Jul 17 • 299 • 2

LeaderboardModel1/gemma-4-E2B-it-qat-q4_0-unquantized-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jul 17 • 91

LeaderboardModel1/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-AutoRound-W4A16-RTN

Text Generation • 0.5B • Updated Jul 18 • 37 • 1

omshunyaom13/qwen3.6-27b-autoround-int4-mm-fable

Text Generation • 6B • Updated Jul 18 • 27

wasifb/Tess-4-27B-AutoRound-W4A16-club3090

3B • Updated Jul 20 • 92

dark-pen/apodex-1.0-0.8B-SFT-rebased-AutoRound-W4A16-Tuning

Text Generation • 0.4B • Updated Jul 20 • 47

GaelicThunder/Qwen3.5-122B-A10B-heretic-hybrid-int4fp8

Text Generation • 21B • Updated Jul 20 • 138

antonyMox/Qwen3.6-27B-abliterated-AutoRound-INT4-MTP

Text Generation • 6B • Updated Jul 20 • 539 • 1

antonyMox/Qwen3.6-27B-AutoRound-INT4-wide-MTP

Text Generation • 11B • Updated Jul 20 • 21

Minachist/Qwen3.6-27B-INT8-Autoround-V2

Image-Text-to-Text • 9B • Updated 29 days ago • 1.53k • 7

nota-ai/Solar-Open2-250B-Nota-INT4

Text Generation • 41B • Updated Jul 23 • 5.69k • 40

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated 27 days ago • 472 • 43

weiweiz1/gemma-4-26B-A4B-it-mix-llmc

3B • Updated Jul 21 • 4

aiakg/gemma-4-26B-A4B-it-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 21 • 270

LeaderboardModel1/Qwen2.5-7B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 22 • 7