AITRADER commited on
Commit
8878ea2
·
verified ·
1 Parent(s): b59b44f

Add repetition_penalty and max_new_tokens to prevent loops

Browse files
Files changed (1) hide show
  1. generation_config.json +3 -1
generation_config.json CHANGED
@@ -9,5 +9,7 @@
9
  "temperature": 0.7,
10
  "top_k": 20,
11
  "top_p": 0.8,
 
 
12
  "transformers_version": "4.57.3"
13
- }
 
9
  "temperature": 0.7,
10
  "top_k": 20,
11
  "top_p": 0.8,
12
+ "repetition_penalty": 1.15,
13
+ "max_new_tokens": 2048,
14
  "transformers_version": "4.57.3"
15
+ }