VLLM Models - 4-6Bit - a feralcrow Collection

feralcrow 's Collections

VLLM Models - 4-6Bit

VLLM Models - 4-6Bit

updated May 31

nvidia/Gemma-4-31B-IT-NVFP4

Text Generation • 21B • Updated May 8 • 2.12M • 530
nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.8M • 114
nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 29 days ago • 8.31M • 455
RedHatAI/gemma-4-31B-it-NVFP4

Image-Text-to-Text • 20B • Updated about 23 hours ago • 515k • 53