chris320211/smoothquant-granite33-2b-g52xlarge
Text Generation • Updated • 378
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
50
Active filters: smoothquant
chris320211/smoothquant-qwen25-15b-g52xlarge
Text Generation • 2B • Updated • 544
chris320211/smoothquant-gemma2-2b-g52xlarge
Text Generation • 3B • Updated • 189
simaai/Qwen3.5-0.8B-Autoround-Safetensors
Image-Text-to-Text • 0.9B • Updated • 40
simaai/Qwen3.5-2B-Autoround-Safetensors
Image-Text-to-Text • 2B • Updated • 36
simaai/Qwen3.5-4B-Autoround-Safetensors
Image-Text-to-Text • 3B • Updated • 38
simaai/Qwen3.5-9B-Autoround-Safetensors
Image-Text-to-Text • 6B • Updated • 41
akumaburn/Swift-1.5-Qwen3.8-27b-heretic-SmoothQuant-W8A8-INT8
Image-Text-to-Text • 27B • Updated • 333
ishita-codes-ai/Qwen3-0.6B-W8A8-INT8
0.6B • Updated • 25
ishita-codes-ai/Qwen3-1.7B-W8A8-INT8
2B • Updated • 23
lazybrick/Qwen3.5-4B-Kiln-INT8-W8A8
Image-Text-to-Text • 5B • Updated • 62
spectator2026/GLM-5.3-Flash-W5-HQQ-g32
Text Generation • 321B • Updated • 135
downtown1629/harrier-oss-v1-270m-smoothquant-a030
Sentence Similarity • Updated • 20
downtown1629/granite-embedding-311m-multilingual-r2-arm64-int8-sq-a045
Sentence Similarity • Updated • 17
marcusnogueira/llama-guard-3-1b-smoothquant-w8a8
1B • Updated • 12
marcusnogueira/llama-guard-3-8b-smoothquant-w8a8
8B • Updated • 12
marcusnogueira/qwen3guard-gen-8b-smoothquant-w8a8
8B • Updated • 15
marcusnogueira/granite-guardian-4.1-8b-smoothquant-w8a8
9B • Updated • 15
marcusnogueira/shieldgemma-9b-smoothquant-w8a8
9B • Updated • 17
spectator2026/Qwen3.8-Flash-Next-W6-INT8-HQQ-g32
Image-Text-to-Text • 181B • Updated • 13