Spaces:

wt3639
/

Course_rec

Paused

Tao Wu commited on Jul 4, 2024

Commit

5b7c0a3

1 Parent(s): 9fbbd17

compare 40 tokens limit

Files changed (1) hide show

app/embedding_setup.py CHANGED Viewed

@@ -92,7 +92,7 @@ def evaluate(
         top_p=1.0,
         top_k=40,
         num_beams=1,
-        max_new_tokens=120,
         batch_size=1,
         **kwargs,
     ):

         top_p=1.0,
         top_k=40,
         num_beams=1,
+        max_new_tokens=30,
         batch_size=1,
         **kwargs,
     ):