inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16
Text Generation • 32B • Updated • 10
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
48
Active filters: INT4
nanishan/Qwen3-Coder-Next.w4a16.gguf
Text Generation • 12B • Updated • 8
lee5j/EXAONE-4.5-33B_GPTQ4
35B • Updated • 40
RedHatAI/MiniMax-M2.5-quantized.w4a16
Text Generation • 34B • Updated • 68
wasifb/Carnice_V2_27B_INT4_BF16MTP
Text Generation • 7B • Updated • 4
88plug/Qwen2.5-Omni-7B-W4A16
Text Generation • 11B • Updated • 1.53k
88plug/Gemma4-E2B-it-W4A16
Image-Text-to-Text • 5B • Updated • 678
88plug/MiniCPM-o-4.5-W4A16
Image-Text-to-Text • 9B • Updated • 84 • 2
88plug/Nemotron-3-Nano-30B-A3B-W4A16
Text Generation • 33B • Updated • 200
88plug/Gemma4-E4B-it-W4A16
Image-Text-to-Text • 8B • Updated • 132
88plug/Qwen3-Omni-30B-W4A16
Text Generation • 35B • Updated • 422 • 1
nwzjk/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16-W4A16-G128
Text Generation • 565B • Updated • 8 • 1
eemin/Carnice_V2_27B_INT4_BF16MTP
Text Generation • 7B • Updated • 1
88plug/Kimi-VL-A3B-Thinking-2506-W4A16
Image-Text-to-Text • 17B • Updated • 153
JunHowie/Qwythos-9B-Claude-Mythos-5-1M-AWQ
Text Generation • 9B • Updated • 1.99k • 1
drowzeys/keys-latest-GLM-5.2-Quantrio-INT4-INT8-Mixed-Abliterated-DFlash
Text Generation • 785B • Updated • 245 • 4
yuesheng123/MiniCPM-o-4.5-W4A16
Image-Text-to-Text • 9B • Updated • 19
agentvue/GLM-5.2-Int4-Int8Mix-FP8KV
Text Generation • 779B • Updated • 45 • 1