amir22010/sarvam-30b-gptq-4bit
Text Generation • 32B • Updated
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
492
Active filters: llm-compressor
ukkathva/telecom-oss-8b-vllm-fp8
Text Generation • 8B • Updated • 11
xy-98/gemma-4-31B-it-FP8-block
Image-Text-to-Text • 31B • Updated • 9
qmxme/Qwen3.6-27B-NVFP4
Text Generation • 10B • Updated • 173 • 2
gratex/mistral-small-3.2-24b-Instruct-2506-NVFP4A16
Image-Text-to-Text • 14B • Updated • 691
JDONE-Research/AIOne-Agent-52B-A36B-it-NVFP4A16
Image-Text-to-Text • 39B • Updated • 11
dokjlahdf/MiniMax-M2.7-abliterated-Heretic-FP8
Text Generation • 229B • Updated • 12
RedHatAI/Qwen3.5-4B-FP8-dynamic
Image-Text-to-Text • 5B • Updated • 39.8k • 4
RedHatAI/Qwen3.5-9B-FP8-dynamic
Image-Text-to-Text • 9B • Updated • 194k • 6
WaveCut/gemma-4-26B-A4B-it-heretic-W4A16-G64-RTN-vllm
Image-Text-to-Text • 27B • Updated • 438
gratex/Qwen3.6-27B-W4A16-g32-asym
Image-Text-to-Text • 29B • Updated • 1.77k
gratex/Kimi-K2.6-REAM-25
Image-Text-to-Text • 130B • Updated • 50
vadery/qwen36-27b-ft-grm-w8a8
Image-Text-to-Text • 28B • Updated • 81
vadery/Qwen3.5-0.8B-W8A8
Image-Text-to-Text • 0.9B • Updated • 401
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4
Image-Text-to-Text • 74B • Updated • 4.25k • 16
dangvansam/chandra-ocr-2-NVFP4A16
Image-Text-to-Text • 3B • Updated • 1.38k • 2
dangvansam/chandra-ocr-2-NVFP4
Image-Text-to-Text • 3B • Updated • 1.48k
spotapovadm/Qwen3.5-9B-quantized.w8a8
Image-Text-to-Text • 9B • Updated • 194
spotapovadm/Qwen3.5-9B-quantized.w4a16
Image-Text-to-Text • 9B • Updated • 7
Reza2kn/MiniCPM5-1B-NVFP4
Text Generation • 0.8B • Updated • 360
amd/gpt-oss-20b-BF16-w8a8-llmcompressor-v0.10.0.2
Text Generation • 21B • Updated • 1.68k
vadery/Qwen3.5-27B-W8A8
Image-Text-to-Text • 28B • Updated • 27
coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-W4A4
Image-Text-to-Text • 21B • Updated • 315
aastalll/Qwen3.5-35B-A3B-NVFP4-MTP
Image-Text-to-Text • 21B • Updated • 49
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-dynamic
Text Generation • 561B • Updated • 7.23k • 1
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-block
Text Generation • 561B • Updated • 9.47k
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Text Generation • 561B • Updated • 800 • 3
JongYeop/Qwen3-30B-A3B-FP8-W8A8
Text Generation • 31B • Updated • 12
JongYeop/Qwen3-30B-A3B-NVFP4-W4A4
Text Generation • 17B • Updated • 38
soyrsoyr/Llama-3.2-1B-Instruct-W8A8-GPTQ
Text Generation • 1B • Updated • 15