Issue

To fix the error below, please delete these additional files that shouldn't have been included:

• model-0000*-of-00004.safetensors are for mlx-community/bu-30b-a3b-preview-4bit ❌

• model-0000*-of-00007.safetensors are for mlx-community/bu-30b-a3b-preview-8bit ✅

Reproducible steps

uv run --no-project --python 3.13 --with mlx-vlm==0.3.9,torchvision==0.24.1,transformers==5.0.0rc1 \
 -- mlx_vlm.generate \
 --model mlx-community/bu-30b-a3b-preview-8bit \
 --prompt "Describe this image." --image <path_to_image>

Error message

ValueError: Expected shape (128, 2048, 192) but received shape (128, 2048, 96)
 for parameter language_model.model.layers.11.mlp.switch_mlp.down_proj.weight