Gemma 4
Collection
88 items • Updated • 133
How to use mlx-community/gemma-4-12B-it-assistant-bf16 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir gemma-4-12B-it-assistant-bf16 mlx-community/gemma-4-12B-it-assistant-bf16
This model was converted to MLX format from google/gemma-4-12B-it-assistant
using mlx-vlm version 0.6.0.
Refer to the original model card for more details on the model.
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/gemma-4-12B-it-assistant-bf16 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
Quantized
Base model
google/gemma-4-12B-it-assistant