Models recomended for 8GB of VRAM and under
-
WhiskyAKM/Gemma-4-12B-it-qat-NVFP4-GGUF
Any-to-Any • 12B • Updated • 3.14k • 1 -
WhiskyAKM/Gemma-4-26B-A4B-it-qat-NVFP4-GGUF
Any-to-Any • 25B • Updated • 1.19k -
WhiskyAKM/Gemma-4-E2B-it-qat-NVFP4-GGUF
Any-to-Any • 5B • Updated • 1.33k -
WhiskyAKM/Gemma-4-E4B-it-qat-NVFP4-GGUF
Any-to-Any • 7B • Updated • 1.45k • 2