RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128
Text Generation • 4B • Updated • 61 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
1,161
Active filters: int4
RedHatAI/whisper-large-v2-W4A16-G128
Automatic Speech Recognition • 2B • Updated • 27 • 1
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation • 8B • Updated • 489
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation • 8B • Updated • 377 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation • 15B • Updated • 347 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation • 33B • Updated • 1.41k • 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation • 71B • Updated • 940 • 6
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation • 2B • Updated • 399 • 1
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 124B • Updated • 62
RedHatAI/pixtral-12b-quantized.w4a16
Image-Text-to-Text • 13B • Updated • 463 • 1
nm-testing/whisper-large-v3.w4a16
Automatic Speech Recognition • 2B • Updated • 6 • 2
empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit
Text Generation • 33B • Updated • 97 • 16
context-labs/neuralmagic-llama-3.1-8b-instruct-Q4KM
Text Generation • 8B • Updated • 10
ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1
Text Generation • 33B • Updated • 8 • 12
tensorblock/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
Updated • 30
FunAGI/LLaDA-8B-Base-gptqmodel-4bit
Text Generation • 8B • Updated • 10 • 1
rpanchum/jais-13b-int4-sym-ov
Text Generation • Updated • 4
rpanchum/falcon3-7b-instruct-int4-sym-ov
Text Generation • Updated • 6
ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g
Image-Text-to-Text • 28B • Updated • 323k • 45
FunAGI/LLaDA-8B-Instruct-gptqmodel-4bit
Text Generation • Updated • 129 • 4
ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g
Image-Text-to-Text • 24B • Updated • 22.2k • 17
FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit
Any-to-Any • 11B • Updated • 40 • 56
RedHatAI/whisper-large-v3-quantized.w4a16
Automatic Speech Recognition • 2B • Updated • 2.78k • 4
RedHatAI/whisper-large-v2-quantized.w4a16
Automatic Speech Recognition • 2B • Updated • 36 • 1
RedHatAI/whisper-large-v3-turbo-quantized.w4a16
Automatic Speech Recognition • 0.9B • Updated • 2.94k • 9
RedHatAI/whisper-medium-quantized.w4a16
Automatic Speech Recognition • 0.8B • Updated • 33
RedHatAI/whisper-small-quantized.w4a16
Automatic Speech Recognition • 0.3B • Updated • 34 • 1
ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g
Image-Text-to-Text • 4B • Updated • 959 • 7
ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g
Image-Text-to-Text • 12B • Updated • 12.2k • 7
RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 530 • 1