MoE models recomended for 8GB of VRAM + MoE offloading
Patryk
WhiskyAKM
AI & ML interests
LLMs for low end hardware
Recent Activity
updated a model 2 days ago
WhiskyAKM/Gemma-4-E2B-it-qat-GGUF updated a model 11 days ago
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF published a model 11 days ago
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUFOrganizations
models 23
WhiskyAKM/Gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 1.13k
WhiskyAKM/MiniCPM5-2B-GGUF
Text Generation • 3B • Updated • 1.09k • 1
WhiskyAKM/MiniCPM5-2B-NVFP4-GGUF
Text Generation • 3B • Updated • 796 • 1
WhiskyAKM/Nemotron-3.5-Lightning-30B-A3B-GGUF
Text Generation • 33B • Updated • 1.69k
WhiskyAKM/Nemotron-3.5-Lightning-30B-A3B-NVFP4-GGUF
Text Generation • 33B • Updated • 610
WhiskyAKM/Ling-3.0-flash-GGUF
Text Generation • 127B • Updated • 925 • 4
WhiskyAKM/Ling-3.0-Tiny-NVFP4-GGUF
Text Generation • 8B • Updated • 426
WhiskyAKM/Ling-3.0-Tiny-GGUF
Text Generation • 8B • Updated • 573 • 3
WhiskyAKM/Gemma-4-26B-A4B-it-qat-GGUF
Any-to-Any • 25B • Updated • 524
WhiskyAKM/Gemma-4-26B-A4B-it-qat-NVFP4-GGUF
Any-to-Any • 25B • Updated • 441
datasets 0
None public yet