Inference Providers
Active filters: gptq
TheStageAI/gemma-4-E4B-it
Image-Text-to-Text
• Updated • 401
• 7
XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1
Text Generation
• 27B • Updated • 1.11k
• 6
TheStageAI/gemma-4-E2B-it
Image-Text-to-Text
• Updated • 547
• 3
Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8
Text Generation
• 33B • Updated • 823
• 23
onnx-community/PaddleOCR-VL-1.5-ONNX
Updated • 592
• 5
LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8
Text Generation
• 44B • Updated • 2.78k
• 10
canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP
Text Generation
• 51B • Updated • 9.13k
• 4
openbmb/MiniCPM-o-2_6-GPTQ
Any-to-Any
• 9B • Updated • 17
• 2
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
Text Generation
• 8B • Updated • 62.7k
• 31
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8
Text Generation
• 33B • Updated • 67.8k
• 14
SEOKDONG/gpt-oss-safeguard-20b-kor-enterprise-gptq-4bit
Text Generation
• 21B • Updated • 73
• 4
Qwen/Qwen3.5-122B-A10B-GPTQ-Int4
Image-Text-to-Text
• 125B • Updated • 165k
• 38
Qwen/Qwen3.5-35B-A3B-GPTQ-Int4
Image-Text-to-Text
• 36B • Updated • 823k
• 86
caiovicentino1/Qwopus3.5-27B-v3-HLWQ-v7-GPTQ
Text Generation
• 27B • Updated • 22
• 6
Vishva007/gemma-4-E4B-it-W4A16-AutoRound-GPTQ
Image-Text-to-Text
• 4B • Updated • 55.6k
• 4
shieldstar/Qwen3.5-122B-A10B-int4-AutoRound-EC
Image-Text-to-Text
• 21B • Updated • 20.9k
• 6
0xSero/GLM-5.1-555B-W4A16
Text Generation
• 78B • Updated • 885
• 8
shieldstar/Qwen3.6-35B-A3B-int4-AutoRound-EC
Image-Text-to-Text
• 6B • Updated • 9.93k
• 7
groxaxo/Qwen3.6-27B-GPTQ-Pro-4bit
Image-Text-to-Text
• 27B • Updated • 101k
• 37
Infatoshi/DeepSeek-V4-Flash-INT2-G64
Text Generation
• Updated • 1
llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-GPTQ-Int4
Image-Text-to-Text
• 28B • Updated • 27.7k
• 3
groxaxo/Qwen3.6-27B-AEON-Ultimate-Uncensored-GPTQ-Pro-FOEM-4bit-g128
Text Generation
• 27B • Updated • 1.04k
• 2
llmfan46/Qwen3.5-27B-uncensored-heretic-v2-Native-MTP-Preserved-GPTQ-Int4
Image-Text-to-Text
• 27B • Updated • 171
• 1
shinigamiRaj/Llama-3.2-1B-Instruct-gptqmodel-4bit
1B • Updated • 40
• 1
elinas/alpaca-13b-lora-int4
Text Generation
• Updated • 17
• 40
elinas/alpaca-30b-lora-int4
Text Generation
• Updated • 24
• 68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
• Updated • 18
• 40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
• Updated • 22
• 121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
• Updated • 9
• 2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
• Updated • 10
• 2