Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,437

Base only

Active filters: auto-round

TearedModels/grepseek-qwen35-9b-grpo-int4-autoround-w4a16

2B • Updated Jun 8 • 5

LeaderboardModel1/Qwen2-0.2B-pt-AutoRound-W4A16-RTN

Text Generation • 0.2B • Updated Jun 9 • 13

LeaderboardModel1/Qwen2-0.2B-it-AutoRound-W4A16-RTN

Text Generation • 0.2B • Updated Jun 9 • 8

LeaderboardModel1/LFM2-Research-AutoRound-W4A16-Tuning

Text Generation • 29.1M • Updated Jun 9 • 7

bullerwins/Nex-N2-Pro-4bit-W4A16

Text Generation • Updated Jun 9 • 318 • 2

LeaderboardModel1/Olmo-3.1-32B-Instruct-SFT-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jun 9 • 8

groxaxo/LocateAnything-3B-AutoRound-W4A16

Image-Text-to-Text • 1B • Updated 6 days ago • 106 • 1

LeaderboardModel1/Apodex-1.0-0.8B-SFT-AutoRound-W4A16-RTN

Text Generation • 0.4B • Updated Jun 10 • 7

LeaderboardModel1/Apodex-1.0-4B-SFT-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 10 • 11

LeaderboardModel1/Apodex-1.0-2B-SFT-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 10 • 7

LeaderboardModel1/Qwen3-Swallow-30B-A3B-RL-v0.2-heretic-AutoRound-NVFP4-RTN

Text Generation • 2B • Updated Jun 10 • 12

maximg/AutoRoundTest

27B • Updated Jun 10 • 8

LeaderboardModel1/neo-3-1B-A90M-Base-AutoRound-W4A16-RTN

Text Generation • 0.2B • Updated Jun 11 • 7

LeaderboardModel1/Supra-50M-Reasoning-AutoRound-W4A16-Tuning

Text Generation • 21.1M • Updated Jun 12 • 11

bullerwins/MiniMax-M3-4bit-W4A16-v0

Image-Text-to-Text • 60B • Updated Jun 13 • 1.37k • 1

LeaderboardModel1/TinyMoE-100m-A1K-AutoRound-NVFP4-Tuning

Text Generation • 0.1B • Updated Jun 13 • 24

eemin/Carnice_V2_27B_INT4_BF16MTP

Text Generation • 7B • Updated Jun 14 • 1

LeaderboardModel1/SmolLM2-135M-AutoRound-W4A16-RTN

Text Generation • 42.6M • Updated Jun 14 • 11

LeaderboardModel1/gemma-3-270m-14L-distilled-AutoRound-W4A16-RTN

Text Generation • 0.2B • Updated Jun 14 • 11

Vishva007/Qwen3.5-4B-W2A16-AutoRound

1B • Updated Jun 14 • 7

Vishva007/Qwen3.5-9B-W2A16-AutoRound

2B • Updated Jun 14 • 25

WaveCut/Qwopus3.6-27B-Coder-FP8-int4-AutoRound

Image-Text-to-Text • 6B • Updated Jun 14 • 9 • 1

Intel/DeepSeek-V4-Pro-W4A16-AutoRound

Text Generation • 220B • Updated Jun 15 • 119

LeaderboardModel1/North-Mini-Code-1.0-AutoRound-W4A16-Tuning

Text Generation • 0.5B • Updated Jun 15 • 15

ThriveLogic/Qwen3-VL-4B-Instruct-W4A16

1B • Updated Jun 15 • 4

ThriveLogic/Qwen3.5-4B-W4A16

1B • Updated Jun 15 • 7

LeaderboardModel1/Qwopus3.6-27B-Coder-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jun 15 • 9 • 1

groxaxo/Qwen3.6-27B-W8A16-AutoRound

Text Generation • 9B • Updated 6 days ago • 541

LeaderboardModel1/Qwen3.6-27B-OBLITERATED-AutoRound-W4A16-Tuning

Text Generation • 3B • Updated Jun 16 • 29 • 1

abhinand/Qwopus3.6-27B-Coder-int4-AutoRound

Text Generation • 6B • Updated Jun 16 • 169 • 2