Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,404

Base only

Active filters: auto-round

plavno/LFM2.5-2.6B-AutoRound-W4A16

Text Generation • 0.6B • Updated 6 days ago • 100

slopops/BigBang-v1-int4-AutoRound-SAR

Image-Text-to-Text • 1B • Updated 6 days ago • 9

letechlead/mybucket

3B • Updated 5 days ago • 3

letechlead/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-INT4-AutoRound

5B • Updated 4 days ago • 1.05k

srswti/axe-superveloce-88b-int4

17B • Updated 4 days ago • 12

INCModel2/MiniMax-M2.7-MXFP4-Mixed-CT-AutoRound

Text Generation • 114B • Updated 4 days ago • 74

INC4AI/Qwen3-8B-fp-w8g128x128-for-ut

8B • Updated 4 days ago • 40

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs64-sym

Text Generation • 0.8B • Updated 3 days ago • 9

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs64-sym

Text Generation • 0.8B • Updated 3 days ago • 11

fbaldassarri/tiiuae_Falcon3-3B-Base-auto_round-int4-gs64-sym

Text Generation • 1B • Updated 3 days ago • 11

fbaldassarri/tiiuae_Falcon3-3B-Instruct-auto_round-int4-gs64-sym

Text Generation • 1B • Updated 3 days ago • 14

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-auto_round-int4-gs64-sym

Text Generation • 0.6B • Updated 3 days ago • 12

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs64-asym

Text Generation • 1B • Updated 3 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs64-sym

Text Generation • 1B • Updated 3 days ago • 11

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs64-asym

Text Generation • 1B • Updated 3 days ago • 14

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs64-sym

Text Generation • 1B • Updated 3 days ago • 12

XReyRobert/Qwen3.8-27B-W4A16-AutoRound-INT8-Head-Embeddings

Image-Text-to-Text • 6B • Updated 1 day ago • 25

bowmanslayer/Qwen3.8-27B-W4A16-vision

Image-Text-to-Text • 27B • Updated about 15 hours ago

bowmanslayer/Qwen3.8-27B-W4A16-vision-mtp

Image-Text-to-Text • 28B • Updated about 6 hours ago

bowmanslayer/Qwen3.8-27B-Uncensored-W4A16-vision

Image-Text-to-Text • 27B • Updated about 7 hours ago

bowmanslayer/Qwen3.8-27B-Uncensored-W4A16-vision-mtp

Image-Text-to-Text • Updated about 6 hours ago

JC1DA/Qwen3.8-27B-heretic-ara-W4A16

Text Generation • 6B • Updated 1 day ago • 116

weiweiz1/Qwen3-4B-mxfp-w8g32

4B • Updated about 16 hours ago

letechlead/Huihui-Qwen3.8-27B-Abliterated-INT4-W4A16-AutoRound

Image-Text-to-Text • 6B • Updated about 2 hours ago