Spaces:

electblake
/

spreadsheet-rl-4b

Running on Zero

electblake commited on 6 days ago

Commit

5cc33d1

verified ·

1 Parent(s): 1f6e504

Limit remote generation to 40 tokens

Files changed (1) hide show

app.py CHANGED Viewed

@@ -8,7 +8,7 @@ def generate(prompt):
     messages = [
         {"role": "user", "content": prompt},
     ]
-    return pipe(messages)[0]["generated_text"][-1]["content"]
 gr.Interface(fn=generate, inputs="text", outputs="text").launch()

     messages = [
         {"role": "user", "content": prompt},
     ]
+    return pipe(messages, max_new_tokens=40)[0]["generated_text"][-1]["content"]
 gr.Interface(fn=generate, inputs="text", outputs="text").launch()