Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

autoquant-agent

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

38

Base only

Active filters: autoquant-agent

INCModel3/Qwen3.5-9B-MXFP8-CT-AutoRound

Text Generation • 10B • Updated Aug 21 • 349

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-AutoRound

Text Generation • 36B • Updated Aug 21 • 27

LeaderboardModel1/gpt-oss-20b-AutoRound-MXFP8

Text Generation • 21B • Updated Aug 24 • 108

INCModel3/gemma-4-31B-MXFP8-CT-AutoRound

Text Generation • 31B • Updated Aug 21 • 34

LeaderboardModel1/gemma-4-26B-AutoRound-MXFP8

Text Generation • 26B • Updated Aug 23 • 13

LeaderboardModel1/gemma-4-26B-A4B-AutoRound-MXFP8

Text Generation • 26B • Updated Aug 24 • 37

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16

Text Generation • 6B • Updated Aug 25 • 205 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-tuning

Text Generation • 6B • Updated Aug 25 • 188 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-v2

Text Generation • 6B • Updated Aug 26 • 237 • 2

lvkaokao/Qwen3-30B-A3B-Instruct-2507-mixed-MXFP8-mxfp4experts

Text Generation • 31B • Updated Sep 9 • 19

lvkaokao/Qwen3-30B-A3B-Instruct-2507-fp8kv-MXFP8

Text Generation • 17B • Updated Sep 9 • 29

lvkaokao/Qwen3-30B-A3B-Instruct-2507-fp8kv-fp8attn-MXFP8

Text Generation • 17B • Updated Sep 9 • 28

lvkaokao/Qwen3-235B-A22B-MXFP4-Mixed-CT-RTN-AutoRound

Text Generation • 235B • Updated Sep 9 • 34

INCModel3/Z-Image-Turbo-MXFP8-RTN-AutoRound

Text-to-Image • Updated Sep 10 • 10

INCModel3/Z-Image-Turbo-MXFP4-RTN-AutoRound

Text-to-Image • Updated Sep 10 • 8

INCModel3/FLUX.2-dev-MXFP4-RTN-AutoRound

Text-to-Image • Updated Sep 11 • 8

INCModel3/FLUX.2-klein-4B-MXFP8-RTN-AutoRound

Text-to-Image • Updated Sep 11 • 6

INCModel3/FLUX.2-klein-4B-MXFP4-RTN-AutoRound

Text-to-Image • Updated Sep 11 • 8

INCModel3/FLUX.2-klein-9B-MXFP8-RTN-AutoRound

Text-to-Image • Updated Sep 12 • 8

INCModel3/FLUX.2-klein-9B-MXFP4-RTN-AutoRound

Text-to-Image • Updated Sep 12 • 8 • 1

INCModel3/Qwen3.5-9B-MXFP4-CT-AutoRound

Text Generation • 10B • Updated Sep 13 • 126

INCModel3/Qwen3.5-9B-MXFP4-FP8KV-CT-AutoRound

Text Generation • 5B • Updated Sep 13 • 39

INCModel3/Qwen3.5-9B-MXFP4-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 5B • Updated Sep 13 • 33

INCModel3/Qwen3.5-9B-MXFP8-CT-RTN-AutoRound

Text Generation • 10B • Updated Sep 13 • 24

INCModel3/Qwen3.5-9B-MXFP8-FP8KV-CT-AutoRound

Text Generation • 2B • Updated Sep 13 • 179

INCModel3/Qwen3.5-9B-MXFP8-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 2B • Updated Sep 13 • 30.8k

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-RTN-AutoRound

Text Generation • 36B • Updated Sep 14 • 50 • 3

INCModel3/Qwen3.5-35B-A3B-MXFP8-FP8KV-CT-AutoRound

Text Generation • 1B • Updated Sep 14 • 28 • 2

INCModel3/Qwen3.5-35B-A3B-MXFP8-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 1B • Updated Sep 14 • 323

INCModel3/Qwen3.8-Flash-Next-MXFP4-Mixed-CT-RTN-AutoRound

Text Generation • Updated 26 days ago • 427