Maybe because LMstudio eats 3GB RAM on it's own?
CyberRat
CyberRat-Equinox
AI & ML interests
None yet
Recent Activity
repliedto danielhanchen's post 2 days ago
Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.
Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.
You can run and train the model via Unsloth Studio.
GGUF: https://huggingface.co/unsloth/gemma-4-12b-it-GGUF
Guide: https://unsloth.ai/docs/models/gemma-4Organizations
None yet
replied to danielhanchen's post 2 days ago