IQuest-Coder-V1-40B-Instruct-nvfp4 / generation_config.json
Firworks's picture
Add NVFP4 quantized checkpoint
0ec8e2e verified
{
"_from_model_config": true,
"bos_token_id": 1,
"do_sample": true,
"eos_token_id": [
2,
75864,
75869
],
"transformers_version": "4.53.3"
}