Phi-4-mini-reasoning-AWQ / generation_config.json
steadyflow's picture
Upload AWQ INT4 quantized Phi-4-mini-reasoning (generic calibration)
287dae2 verified
{
"_from_model_config": true,
"bos_token_id": 199999,
"do_sample": true,
"eos_token_id": [
200020,
199999
],
"pad_token_id": 199999,
"transformers_version": "5.3.0",
"use_cache": true
}