Kimi-VL-A3B-Thinking-2506-FP8-Dynamic / generation_config.json
JimmyFoxx's picture
Add FP8 dynamic quantized weights
e11bdcf verified
{
"bos_token_id": 163584,
"do_sample": true,
"eos_token_id": [
163585
],
"pad_token_id": 163838,
"temperature": 0.6,
"transformers_version": "4.53.2"
}