experiment024b-AutoRound-W4A16-RTN / generation_config.json
INC4AI's picture
Upload quantized model experiment024b-AutoRound-W4A16-RTN
7f57627 verified
Raw
History Blame Contribute Delete
176 Bytes
{
"_from_model_config": true,
"bos_token_id": 1,
"do_sample": true,
"eos_token_id": 2,
"pad_token_id": 11,
"transformers_version": "5.12.1",
"use_cache": false
}