bernini-mlx / q8 /mllm /generation_config.json
SceneWorks's picture
Add q4/q8/bf16 quant-matrix tier subdirs (sc-9945, epic 8506)
533d688 verified
Raw
History Blame Contribute Delete
216 Bytes
{
"bos_token_id": 151643,
"pad_token_id": 151643,
"do_sample": true,
"eos_token_id": [
151645,
151643
],
"repetition_penalty": 1.05,
"temperature": 0.000001,
"transformers_version": "4.37.0"
}