Models built for coding tasks that work on low VRAM systems (6GB min)
Marcus Johnson
ByteMeBiscuit
AI & ML interests
None yet
Recent Activity
updated a collection about 2 months ago
Low-VRAM Models in Testing updated a collection about 2 months ago
Low-VRAM Models in Testing updated a collection about 2 months ago
Low-VRAM Models in TestingOrganizations
None yet
Whether or not a model can run with 6GB of VRAM or less. Models are being tested against conversational interactions and instruction following.
-
huihui-ai/Huihui-Qwen3.5-9B-abliterated
Image-Text-to-Text • 10B • Updated • 7.88k • • 171 -
huihui-ai/Huihui-Qwen3.5-4B-abliterated
Image-Text-to-Text • 5B • Updated • 19.8k • • 56 -
openbmb/MiniCPM5-2B
Text Generation • 3B • Updated • 1.07M • 1.84k -
unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 208k • 609
Models built for coding tasks that work on low VRAM systems (6GB min)
Whether or not a model can run with 6GB of VRAM or less. Models are being tested against conversational interactions and instruction following.
-
huihui-ai/Huihui-Qwen3.5-9B-abliterated
Image-Text-to-Text • 10B • Updated • 7.88k • • 171 -
huihui-ai/Huihui-Qwen3.5-4B-abliterated
Image-Text-to-Text • 5B • Updated • 19.8k • • 56 -
openbmb/MiniCPM5-2B
Text Generation • 3B • Updated • 1.07M • 1.84k -
unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 208k • 609
Can it run on 6GB of VRAM? If it's here, it can.