Gemma 4 MLX Quantizations
MLX-LM affine quantizations for Gemma4; see each model card for details. · Get MLXHub: mlxhub.app
Text Generation • 5B • Updated • 340Note 4-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-4bit
Text Generation • 31B • Updated • 24Note 4-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-6bit
Text Generation • 31B • Updated • 38Note 6-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-8bit
Text Generation • 31B • Updated • 27Note 8-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-4bit
Text Generation • 25B • Updated • 25Note 4-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-6bit
Text Generation • 25B • Updated • 24Note 6-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-8bit
Text Generation • 25B • Updated • 29Note 8-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-4bit
Text Generation • 12B • Updated • 34Note 4-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-6bit
Text Generation • 12B • Updated • 62Note 6-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-8bit
Text Generation • 12B • Updated • 36Note 8-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-4bit
Text Generation • 7B • Updated • 245Note 4-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-6bit
Text Generation • 7B • Updated • 36Note 6-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-8bit
Text Generation • 7B • Updated • 100 • 1Note 8-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E2B-it-6bit
Text Generation • 5B • Updated • 50Note 6-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E2B-it-8bit
Text Generation • 5B • Updated • 16Note 8-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.