Add generation_config.json (temperature=1.0, top_p=0.95, ZAI defaults)
Browse filesRestores the base model's sampling defaults so serving engines with model-based sampling defaults apply top_p=0.95 when clients omit it. Fixes intermittent thinking-mode repetition loops / empty content reported in sgl-project/sglang#29512.
- generation_config.json +12 -0
generation_config.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_from_model_config": true,
|
| 3 |
+
"eos_token_id": [
|
| 4 |
+
154820,
|
| 5 |
+
154827,
|
| 6 |
+
154829
|
| 7 |
+
],
|
| 8 |
+
"pad_token_id": 154820,
|
| 9 |
+
"temperature": 1.0,
|
| 10 |
+
"top_p": 0.95,
|
| 11 |
+
"transformers_version": "5.12.0"
|
| 12 |
+
}
|