Gemma 4 MLX Quantizations - a DreamFoundries Collection

DreamFoundries 's Collections

Qwen3.8 MLX Quants

Laguna S 2.1 MLX Quantizations

Qwen AgentWorld MLX Quantizations

Agents A1 MLX Quantizations

SuperQwen AgentWorld MLX Quantizations

SuperGemma4 MLX Quantizations

Ornith 1.0 MLX Quantizations

Nemotron 3 MLX Quantizations

Qwen 3.6 MLX Quantizations

Qwen 3.5 MLX Quantizations

Gemma 4 MLX Quantizations

updated Jun 29

MLX-LM affine quantizations for Gemma4; see each model card for details.

Upvote

DreamFoundries/gemma-4-E2B-it-4bit

Text Generation • 0.7B • Updated Jun 29 • 39

Note 4-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-4bit

Text Generation • 31B • Updated Jun 28 • 12

Note 4-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-6bit

Text Generation • 31B • Updated Jun 28 • 6

Note 6-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-31B-it-8bit

Text Generation • 31B • Updated Jun 28 • 16

Note 8-bit MLX-LM affine quantization of google/gemma-4-31B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-4bit

Text Generation • 25B • Updated Jun 28 • 23

Note 4-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-6bit

Text Generation • 25B • Updated Jun 29 • 10

Note 6-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-26B-A4B-it-8bit

Text Generation • 25B • Updated Jun 29 • 16

Note 8-bit MLX-LM affine quantization of google/gemma-4-26B-A4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-4bit

Text Generation • 12B • Updated Jun 29 • 25

Note 4-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-6bit

Text Generation • 12B • Updated Jun 29 • 16

Note 6-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-12B-it-8bit

Text Generation • 12B • Updated Jun 29 • 21

Note 8-bit MLX-LM affine quantization of google/gemma-4-12B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-4bit

Text Generation • 1B • Updated Jun 29 • 53

Note 4-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-6bit

Text Generation • 7B • Updated Jun 29 • 9

Note 6-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E4B-it-8bit

Text Generation • 7B • Updated Jun 29 • 23

Note 8-bit MLX-LM affine quantization of google/gemma-4-E4B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E2B-it-6bit

Text Generation • 1B • Updated Jun 29 • 4

Note 6-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.
DreamFoundries/gemma-4-E2B-it-8bit

Text Generation • 1B • Updated Jun 29 • 6

Note 8-bit MLX-LM affine quantization of google/gemma-4-E2B-it. No comparative benchmarks yet.

Upvote