QWen-Coder-1.5B-nf4 / generation_config.json
leokmax's picture
Upload 4bit quantized Qwen2.5-7B with bitsandbytes
d06cab6 verified
{
"bos_token_id": 151643,
"eos_token_id": 151643,
"max_new_tokens": 2048,
"transformers_version": "4.52.4"
}