Inference Providers
Active filters: INT4
iSolver-AI/test123-quantized.w4a16
Image-Text-to-Text
• Updated • 2
RedHatAI/phi-4-quantized.w4a16
Text Generation
• 3B • Updated • 810
• 5
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text
• 5B • Updated • 2.95k
• 10
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation
• 104B • Updated • 310
• 7
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text
• 20B • Updated • 3.4k
• 12
RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation
• 1B • Updated • 20.6k
• 4
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation
• 0.8B • Updated • 5.46k
• 3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation
• 0.4B • Updated • 2.08k
RedHatAI/Qwen3-32B-quantized.w4a16
Text Generation
• 6B • Updated • 1.36k
• 12
RedHatAI/Qwen3-14B-quantized.w4a16
Text Generation
• 3B • Updated • 294
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation
• 8B • Updated • 23.6k
• 3
WaveCut/PixelWave_FLUX.1-schnell_04_SVDQuant-int4
Text-to-Image
• Updated • 24
• 1
RedHatAI/Qwen3-30B-A3B-quantized.w4a16
Text Generation
• 5B • Updated • 1.77k
• 7
RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Text Generation
• 676B • Updated • 1.11k
• 13
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16
Image-Text-to-Text
• 59B • Updated • 577
• 1
RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation
• 1T • Updated • 1.11k
• 12
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation
• 4B • Updated • 12
• 2
ChibuUkachi/Qwen3-4B-Instruct-2507.w4a16
Text Generation
• 1B • Updated • 7
RedHatAI/Qwen3-4B-Thinking-2507-quantized.w4a16
Text Generation
• 4B • Updated • 60
RedHatAI/Qwen3-4B-Instruct-2507-quantized.w4a16
Text Generation
• 4B • Updated • 305
RedHatAI/Qwen3-30B-A3B-Thinking-2507-quantized.w4a16
Text Generation
• 5B • Updated • 258
RedHatAI/Qwen3-30B-A3B-Instruct-2507-quantized.w4a16
Text Generation
• 5B • Updated • 1.93k
• 1
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Text Generation
• 12B • Updated • 563
• 3
RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Text Generation
• Updated • 9
EmbeddedLLM/Qwen3-VL-30B-A3B-Instruct.w4a16
Text Generation
• 5B • Updated • 9
• 1
EmbeddedLLM/Qwen3-VL-30B-A3B-Thinking.w4a16
Text Generation
• 5B • Updated • 6
RedHatAI/Ministral-3-14B-Instruct-2512-FP8-dynamic
Text Generation
• 14B • Updated • 223
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation
• 12B • Updated • 167
• 1
nanishan/Qwen3-Coder-Next.w4a16.gguf
Text Generation
• 12B • Updated • 8
lee5j/EXAONE-4.5-33B_GPTQ4
35B • Updated • 52