Gemma 4 MLX Quantizations
MLX-LM affine quantizations for Gemma4; see each model card for details. · Get MLXHub: mlxhub.app
Text Generation • 5B • Updated • 332Note 4-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-4bit
Text Generation • 31B • Updated • 22Note 4-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-6bit
Text Generation • 31B • Updated • 36Note 6-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-8bit
Text Generation • 31B • Updated • 25Note 8-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-4bit
Text Generation • 25B • Updated • 23Note 4-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-6bit
Text Generation • 25B • Updated • 26Note 6-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-8bit
Text Generation • 25B • Updated • 29Note 8-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-4bit
Text Generation • 12B • Updated • 33Note 4-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-6bit
Text Generation • 12B • Updated • 65Note 6-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-8bit
Text Generation • 12B • Updated • 36Note 8-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-4bit
Text Generation • 7B • Updated • 227Note 4-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-6bit
Text Generation • 7B • Updated • 33Note 6-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-8bit
Text Generation • 7B • Updated • 104 • 1Note 8-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E2B-it-6bit
Text Generation • 5B • Updated • 50Note 6-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E2B-it-8bit
Text Generation • 5B • Updated • 16Note 8-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.