granite-4.0-h-small-FP8-dynamic / generation_config.json
alexmarques's picture
Replace model with updated FP8 dynamic quantization (#1)
1500ffa verified
raw
history blame contribute delete
147 Bytes
{
"_from_model_config": true,
"bos_token_id": 100257,
"eos_token_id": 100257,
"pad_token_id": 100256,
"transformers_version": "4.57.1"
}