Models recomended for 8GB of VRAM and under
Patryk
WhiskyAKM
AI & ML interests
LLMs for low end hardware
Recent Activity
updated a model 1 day ago
WhiskyAKM/G9v3-3B-GGUF updated a model 1 day ago
WhiskyAKM/G9v3-3B-NVFP4-GGUF updated a collection 1 day ago
Low Vram NVFP4 2026.07Organizations
None yet
models 12
WhiskyAKM/G9v3-3B-GGUF
Text Generation • 3B • Updated • 751
WhiskyAKM/G9v3-3B-NVFP4-GGUF
Text Generation • 3B • Updated • 178
WhiskyAKM/Qwen3.6-35B-A3B-NVFP4-GGUF
Image-Text-to-Text • 36B • Updated • 336
WhiskyAKM/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 36B • Updated • 422
WhiskyAKM/Gemma-4-E4B-it-qat-NVFP4-GGUF
Any-to-Any • 7B • Updated • 683 • 1
WhiskyAKM/Gemma-4-12B-it-qat-NVFP4-GGUF
Any-to-Any • 12B • Updated • 383
WhiskyAKM/Gemma-4-E2B-it-qat-NVFP4-GGUF
Any-to-Any • 5B • Updated • 337
WhiskyAKM/Gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 319
WhiskyAKM/Gemma-4-E4B-it-qat-GGUF
Any-to-Any • 7B • Updated • 406
WhiskyAKM/Gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 484
datasets 0
None public yet