h4x3rotab commited on
Commit
427b2cb
·
verified ·
1 Parent(s): 8dc3a42

Add generation_config.json (temperature=1.0, top_p=0.95, ZAI defaults)

Browse files

Restores the base model's sampling defaults so serving engines with model-based sampling defaults apply top_p=0.95 when clients omit it. Fixes intermittent thinking-mode repetition loops / empty content reported in sgl-project/sglang#29512.

Files changed (1) hide show
  1. generation_config.json +12 -0
generation_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "eos_token_id": [
4
+ 154820,
5
+ 154827,
6
+ 154829
7
+ ],
8
+ "pad_token_id": 154820,
9
+ "temperature": 1.0,
10
+ "top_p": 0.95,
11
+ "transformers_version": "5.12.0"
12
+ }