MistriDevLab

Build error

johann22 commited on Dec 23, 2023

Commit

f4800cd

1 Parent(s): 8a306f2

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -57,7 +57,7 @@ def run_gpt(
     generate_kwargs = dict(
         temperature=0.9,
-        max_new_tokens=10480,
         top_p=0.95,
         repetition_penalty=1.0,
         do_sample=True,

     generate_kwargs = dict(
         temperature=0.9,
+        max_new_tokens=1048,
         top_p=0.95,
         repetition_penalty=1.0,
         do_sample=True,