mistral_fp8 / generation_config.json
roleplaiapp's picture
Duplicate from RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8
92eec81 verified
raw
history blame contribute delete
188 Bytes
{
"do_sample": true,
"bos_token_id": 1,
"eos_token_id": 2,
"pad_token_id": 11,
"temperature": 0.15,
"max_length": 131072,
"top_p": 1.00,
"transformers_version": "4.52.4"
}