Inference Providers
Active filters: Int4
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation • 15B • Updated • 2.73k
• 5
AXERA-TECH/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4
Updated • 26
• 1
AXERA-TECH/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4
Updated • 19
• 1
AXERA-TECH/Qwen2.5-1.5B-Instruct-GPTQ-Int4
Text Generation • Updated • 101
AXERA-TECH/Qwen2.5-3B-Instruct-GPTQ-Int4
Updated • 12
AXERA-TECH/Qwen2.5-0.5B-Instruct-GPTQ-Int4
Text Generation • Updated • 60
AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation • 0.6B • Updated • 796
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation • 2B • Updated • 58
• 1
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation • 33B • Updated • 823
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation • 5B • Updated • 24
• 1
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation • 8B • Updated • 945
• 4
JunHowie/Qwen3-4B-GPTQ-Int4
Text Generation • 4B • Updated • 235
• 2
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation • 4B • Updated • 942
• 4
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4
Text Generation • 4B • Updated • 37
• 1
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Text Generation • 31B • Updated • 642
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Text Generation • 31B • Updated • 66
JunHowie/Qwen2-7B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 10
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation • 36B • Updated • 8
QuantTrio/KAT-Dev-GPTQ-Int4
Text Generation • 33B • Updated • 19
• 1
QuantTrio/Kimi-Dev-72B-GPTQ-Int4
Text Generation • 73B • Updated • 33
• 2
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 42
• 1
AXERA-TECH/Qwen3-VL-4B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 29
AXERA-TECH/Qwen3-VL-8B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 11
• 1
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C
Image-Text-to-Text • Updated • 10
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P256-CTX384
Image-Text-to-Text • Updated • 8
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P320-CTX448
Image-Text-to-Text • Updated • 18
AXERA-TECH/Qwen3-1.7B-GPTQ-Int4
Text Generation • Updated • 16
AXERA-TECH/Xiaomi-MiMo-VL-Miloco-7B-AX650-GPTQ-Int4
Image-Text-to-Text • Updated • 4
AXERA-TECH/Qwen2.5-VL-3B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 7