huihui-ai/Huihui-gemma-4-E4B-it-qat-q4_0-unquantized-abliterated-GGUF
Any-to-Any • 7B • Updated • 17.3k • 31
Can it run on 6GB of VRAM? If it's here, it can.
Note This is arguably the best model in its class right now. The response times are 10-20% faster than the Qwen3 model, the responses are richer (subjectively), and it's blowing every benchmark out of the water. I hate AI, but this model is genuinely impressive.
Note Run this with Q4_K_M. Q5 will double and triple response times.