Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

autoquant-agent

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9

Base only

Active filters: autoquant-agent

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-tuning

Text Generation • 6B • Updated 9 days ago • 96 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-v2

Text Generation • 6B • Updated 8 days ago • 307 • 2

LeaderboardModel1/Qwen3.5-9B-AutoRound-MXFP8

Text Generation • 10B • Updated 13 days ago • 28

LeaderboardModel1/Qwen3.5-35B-A3B-AutoRound-MXFP8

Text Generation • 36B • Updated 13 days ago • 18

LeaderboardModel1/gpt-oss-20b-AutoRound-MXFP8

Text Generation • 21B • Updated 10 days ago • 486

LeaderboardModel1/gemma-4-31B-AutoRound-MXFP8

Text Generation • 31B • Updated 13 days ago • 11

LeaderboardModel1/gemma-4-26B-AutoRound-MXFP8

Text Generation • 26B • Updated 11 days ago • 21

LeaderboardModel1/gemma-4-26B-A4B-AutoRound-MXFP8

Text Generation • 26B • Updated 10 days ago • 16

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16

Text Generation • 6B • Updated 9 days ago • 333 • 1