Include the torch_dtype in the model config.json.
This matches the config.json of similar releases (e.g., Mistral-Large-Instruct-2407, Mistral-Small-24B-Instruct-2501).

can someone please help merge this?

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment