Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,436

Base only

Active filters: auto-round

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_gptq-int4-gs64-asym

Text Generation • 0.7B • Updated Jun 22 • 7

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_gptq-int4-gs64-sym

Text Generation • 0.7B • Updated Jun 22 • 6

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_awq-int4-gs64-asym

Text Generation • 0.7B • Updated Jun 22 • 9

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_awq-int4-gs64-sym

Text Generation • 0.7B • Updated Jun 22 • 7

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_round-int8-gs64-asym

Text Generation • 0.8B • Updated Jun 22 • 8

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_round-int8-gs64-sym

Text Generation • 0.8B • Updated Jun 22 • 7

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_gptq-int8-gs64-asym

Text Generation • 0.8B • Updated Jun 22 • 6

fbaldassarri/tiiuae_Falcon3-1B-Instruct-auto_gptq-int8-gs64-sym

Text Generation • 0.8B • Updated Jun 22 • 7

INCModel2/GLM-5.2-W4A16-AutoRound

Text Generation • 103B • Updated Jun 23 • 592 • 3

simonepstein/Qwen3.5-122B-A10B-int4-AutoRound-OpenCode

18B • Updated Jun 23 • 60 • 1

LeaderboardModel1/Qwen3.6-35B-A3B-Heretic-REAP-0.30-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 24 • 24 • 1

bleysg/Qwen3.5-122B-A10B-int4-fp8-hybrid

Text Generation • 20B • Updated Jun 24 • 21.8k • 9

LeaderboardModel1/Qwen-AgentWorld-35B-A3B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 24 • 163 • 2

LeaderboardModel1/Qwen3.6-35B-A3B-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jun 24 • 140

LeaderboardModel1/Nex-N2-mini-ultra-uncensored-heretic-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 24 • 11

LeaderboardModel1/Nex-N2-mini-ultra-uncensored-heretic-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jun 24 • 81

LeaderboardModel1/Qwento-Agentic-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 25 • 40 • 1

Intel/diffusiongemma-26B-A4B-it-int4-AutoRound

Image-Text-to-Text • 9B • Updated Jun 26 • 6.09k • 3

LeaderboardModel1/Qwopus3.6-27B-v2-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jun 25 • 17 • 1

0xSero/GLM-5.2-504B-W4A16

Text Generation • 68B • Updated Jun 25 • 166 • 4

giganeko/Qwopus3.6-27B-v2-AutoRound-GGUF

Image-Text-to-Text • 27B • Updated Jun 25 • 24

LeaderboardModel1/Qwen-AgentWorld-35B-A3B-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jul 2 • 65 • 1

LeaderboardModel1/Darwin-28B-REASON-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jun 25 • 102 • 7

LeaderboardModel1/Qwen3.6-35B-A3B-uncensored-heretic-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 25 • 22

LeaderboardModel1/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 26 • 20

LeaderboardModel1/Qwen3.6-35B-A3B-StyleTune-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 26 • 23

LeaderboardModel1/Qwen3.5-24.5B-Reapped-v1-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 26 • 11

LeaderboardModel1/Ornith-1.0-35B-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jun 26 • 473 • 3

LeaderboardModel1/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jun 27 • 111

LeaderboardModel1/Qwevolution-V0-27B-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jun 27 • 24