quantized-W4A8 / generation_config.json
zay25's picture
Upload Qwen3ForCausalLM
d69208c verified
{
"bos_token_id": 151643,
"eos_token_id": 151643,
"max_new_tokens": 2048,
"transformers_version": "4.51.3"
}