RedHatAI/gemma-4-31B-it-NVFP4
Image-Text-to-Text • 20B • Updated • 188k • 49
Edit Models filters
Model Tree
Apps
Inference Providers
Models
274
Active filters: llm-compressor
RedHatAI/gemma-4-31B-it-FP8-block
Image-Text-to-Text • 31B • Updated • 290k • 30
Sehyo/Qwen3.5-397B-A17B-NVFP4
Updated • 339 • 7
ebircak/gemma-4-31B-it-4bit-W4A16-AWQ
Text Generation • 32B • Updated • 40.5k • 2
ghecko78/Voxtral-Mini-4B-Realtime-2602-FP8-Dynamic
Automatic Speech Recognition • 4B • Updated • 27.8k • 2
ocicek/Qwen3.6-27B-NVFP4
Text Generation • 17B • Updated • 42.9k • 4
RedHatAI/Qwen3.5-9B-FP8-dynamic
Image-Text-to-Text • 9B • Updated • 132k • 3
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4
Image-Text-to-Text • 74B • Updated • 1.98k • 3
RedHatAI/Qwen2.5-0.5B-quantized.w8a16
Text Generation • 0.6B • Updated • 475
RedHatAI/Qwen2.5-1.5B-quantized.w8a16
Text Generation • 2B • Updated • 11
RedHatAI/Qwen2.5-3B-quantized.w8a16
Text Generation • 3B • Updated • 21
RedHatAI/Qwen2.5-7B-quantized.w8a16
Text Generation • 8B • Updated • 11 • 1
RedHatAI/Qwen2.5-32B-quantized.w8a16
Text Generation • 33B • Updated • 12
RedHatAI/Qwen2.5-72B-quantized.w8a16
Text Generation • 73B • Updated • 21
RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation • 15B • Updated • 132k • 1
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
Text Generation • 4B • Updated • 392 • 1
jsbaicenter/r1-1776-distill-llama-70b-FP8-Dynamic
Text Generation • 71B • Updated • 1
divish/M-Prometheus-3B-FP8-Dynamic
Text Generation • 3B • Updated • 5
textgeflecht/Devstral-Small-2505-FP8-llmcompressor
Text Generation • 24B • Updated • 7
ConfidentialMind/InternVL3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 8 • 2
textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic
Text Generation • 33B • Updated • 10
brandonbeiler/InternVL3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 73
brandonbeiler/InternVL3-78B-FP8-Dynamic
Image-Text-to-Text • 78B • Updated • 9
brandonbeiler/InternVL3-8B-FP8-Dynamic
Image-Text-to-Text • 8B • Updated • 11 • 2
RedHatAI/Qwen3-30B-A3B-FP8-block
Text Generation • 31B • Updated • 19.3k
JustJaro/SmolLM-135M-FP8-Static
Image-Text-to-Text • 0.2B • Updated • 4
JustJaro/SmolLM-135M-FP8-Dynamic-Test
Image-Text-to-Text • 0.1B • Updated • 2
JustJaro/GOT-OCR-2.0-hf-FP8-Static
Image-Text-to-Text • 0.6B • Updated • 5
brandonbeiler/Skywork-R1V3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 6 • 2
ramblingpolymath/Qwen3-32B-W8A8
Text Generation • 33B • Updated • 3