unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 14.7k • 92
Gemma 4 QAT
Gemma 4 QAT (Quantization-Aware Training) for 3x less memory use and near original accuracy.
Note GGUFs to run:
-
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 28.4k • 63 -
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 11k • 34 -
unsloth/gemma-4-E4B-it-qat-GGUF
Any-to-Any • 7B • Updated • 7.41k • 25 -
unsloth/gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 3.7k • 19 -
unsloth/gemma-4-E2B-it-qat-mobile-GGUF
Any-to-Any • 5B • Updated • 1.12k • 9 -
unsloth/gemma-4-E4B-it-qat-mobile-GGUF
Any-to-Any • 7B • Updated • 1.48k • 9 -
unsloth/gemma-4-26B-A4B-it-qat-q4_0-unquantized
Image-Text-to-Text • 27B • Updated • 9 • 2
unsloth/gemma-4-E2B-it-qat-q4_0-unquantized
Any-to-Any • 5B • Updated • 9 • 2Note BF16 Safetensor:
-
unsloth/gemma-4-E4B-it-qat-q4_0-unquantized
Any-to-Any • 8B • Updated • 21 • 2 -
unsloth/gemma-4-12B-it-qat-q4_0-unquantized
Any-to-Any • 12B • Updated • 57 • 3 -
unsloth/gemma-4-31B-it-qat-q4_0-unquantized
Image-Text-to-Text • 33B • Updated • 4 • 2 -
unsloth/gemma-4-E2B-it-qat-mobile
Any-to-Any • 2B • Updated • 64 • 2 -
unsloth/gemma-4-E4B-it-qat-mobile
Any-to-Any • 3B • Updated • 19 • 3 -
unsloth/gemma-4-E4B-it-qat-w4a16
Any-to-Any • 9B • Updated • 294 • 2 -
unsloth/gemma-4-E2B-it-qat-w4a16
Any-to-Any • 6B • Updated • 603 • 2