Marlin-2B-MLX-8bit / generation_config.json
HappyPablo's picture
Marlin-2B MLX 8-bit weights (mlx-vlm convert, --q-bits 8)
9c8ad08 verified
Raw
History Blame Contribute Delete
137 Bytes
{
"_from_model_config": true,
"eos_token_id": [
248044,
248046
],
"transformers_version": "5.7.0",
"use_cache": true
}