moonshine-tiny-optimized / generation_config.json
felixem's picture
Optimized: FP16 + SDPA attention + static KV cache support
07817bd verified
{
"_from_model_config": true,
"bos_token_id": 1,
"decoder_start_token_id": 1,
"eos_token_id": 2,
"max_length": 194,
"pad_token_id": 2,
"transformers_version": "4.57.6"
}