Upload model.safetensors.index.json

#1
MLX Community org
edited Jan 3

Fix safetensors index.json overwritten by mlx-vlm regression (https://github.com/Blaizzy/mlx-vlm/issues/624)

This model was converted with mlx-vlm v0.1.19 (mlx_vlm.convert). Due to issue #624, the correct
model.safetensors.index.json generated during conversion can be overwritten by the source model’s index,
causing an index↔shard mismatch.

Change:

  • Replace model.safetensors.index.json to match the actual shard files in this repo.

No weight files were changed.

MLX Community org
edited Jan 3

⚠️ Known Issue (Separate Bug)

This fix resolves the index mismatch only. The model still fails at runtime with:

Number of image token positions (5476) does not match number of image features (1369)

This is a separate mlx-vlm vision feature mismatch bug (not related to #624).
The index.json fix is technically correct but insufficient for model functionality.

Recommendation: Maintainers may choose to:

  • Merge: Partial fix (index correct, documented limitation)
  • Close: Wait for full fix once vision feature bug resolved upstream
  • Keep open: Track as part of broader mlx-vlm stability effort
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment