gemma4-v3-4epoch-quantized-fp8 / generation_config.json
Pradeep-Corethink's picture
FP8 quantization (router excluded), sanity-checked, pending BFCL eval
3f90a6b verified
Raw
History Blame Contribute Delete
204 Bytes
{
"bos_token_id": 2,
"do_sample": true,
"eos_token_id": [
1,
106,
50
],
"pad_token_id": 0,
"temperature": 1.0,
"top_k": 64,
"top_p": 0.95,
"transformers_version": "5.10.1"
}