Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,436

Base only

Active filters: auto-round

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int8-gs64-asym

Text Generation • 0.5B • Updated Jun 28 • 5

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int8-gs64-sym

Text Generation • 0.5B • Updated Jun 28 • 12

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int8-gs64-asym

Text Generation • 0.5B • Updated Jun 28 • 5

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int8-gs64-sym

Text Generation • 0.5B • Updated Jun 28 • 8

fbaldassarri/TinyLlama_TinyLlama_v1.1-auto_round-int8-gs64-asym

Text Generation • 0.4B • Updated Jun 28 • 10

fbaldassarri/TinyLlama_TinyLlama_v1.1-auto_round-int8-gs64-sym

Text Generation • 0.4B • Updated Jun 28 • 6

fbaldassarri/TinyLlama_TinyLlama_v1.1-auto_gptq-int8-gs64-sym

Text Generation • 0.4B • Updated Jun 28 • 4

nota-ai/Qwen3.5-122B-A10B-NotaCompression-INT4

Text Generation • 22B • Updated Jun 29 • 237 • 1

LeaderboardModel1/Qwythos-9B-Claude-Mythos-5-1M-AutoRound-W4A16-RTN

Text Generation • 2B • Updated Jun 29 • 6

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_round-int4-gs64-asym

Text Generation • 0.4B • Updated Jun 29 • 6

LeaderboardModel1/Qwen2-57B-A14B-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jun 29 • 7

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_gptq-int4-gs64-asym

Text Generation • 0.4B • Updated Jun 29 • 12

LeaderboardModel1/QoolKid-14b-AutoRound-W4A16-RTN

Text Generation • 2B • Updated Jun 29 • 8

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_gptq-int4-gs64-sym

Text Generation • 0.4B • Updated Jun 29 • 10

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-auto_awq-int4-gs64-sym

Text Generation • 0.4B • Updated Jun 29 • 4

LeaderboardModel1/Qwythos-9B-Claude-Mythos-5-1M-AutoRound-W4A16-Tuning

Text Generation • 2B • Updated Jun 30 • 32

LeaderboardModel1/Qwen3.6-35B-A3B-uncensored-heretic-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jun 30 • 18

LeaderboardModel1/osmFableQwopus-3.6-27B-Uncensored-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jun 30 • 9

LeaderboardModel1/Qwable-v2-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 1 • 326

weiweiz1/DeepSeek-V2-Lite-int4-AutoRound

3B • Updated Jul 1 • 330

Koemhort/gemma-4-E4B-it-4bit-autoround

4B • Updated Jul 1 • 6

LeaderboardModel1/gemma-4-12B-AutoRound-MXFP4-RTN

Text Generation • 3B • Updated Jul 1 • 11

fraserprice/Ornith-1.0-397B-W4A16-AutoRound-DFlash

Text Generation • Updated Jul 2 • 319

LeaderboardModel1/Ornith-1.0-35B-uncensored-heretic-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 1 • 561

LeaderboardModel1/Ornith-1.0-35B-uncensored-heretic-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jul 1 • 48

LeaderboardModel1/DeepSeek-R1-Distill-Qwen-1.5B-AutoRound-NVFP4-Tuning

Text Generation • 2B • Updated Jul 1 • 14

LeaderboardModel1/Carnice-Qwen3.6-MoE-35B-A3B-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated Jul 1 • 33

LeaderboardModel1/experiment024b-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 2 • 15

weiweiz1/Qwen1.5-MoE-A2.7B-int4-AutoRound

2B • Updated Jul 2 • 14

poma-ai/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Jul 2 • 281