Models recomended for 8GB of VRAM and under
-
WhiskyAKM/Gemma-4-12B-it-qat-NVFP4-GGUF
Any-to-Any • 12B • Updated • 607 • 1 -
WhiskyAKM/Gemma-4-26B-A4B-it-qat-NVFP4-GGUF
Any-to-Any • 25B • Updated • 785 • 1 -
WhiskyAKM/Gemma-4-E2B-it-qat-NVFP4-GGUF
Any-to-Any • 5B • Updated • 1.11k • 1 -
WhiskyAKM/Gemma-4-E4B-it-qat-NVFP4-GGUF
Any-to-Any • 7B • Updated • 446 • 2