test_steerable_hf_model_v4 / generation_config.json
atrost's picture
Add steerable Qwen2 (post-block adapters) with auto_map + code
c6a079c verified
{
"_from_model_config": true,
"bos_token_id": 151646,
"do_sample": true,
"eos_token_id": 151643,
"temperature": 0.6,
"top_p": 0.95,
"transformers_version": "4.57.3"
}