Spaces:

AC2513
/

gemma-demo

Running on Zero

AC2513 commited on Jul 11

Commit

d54c706

1 Parent(s): 0df6b7c

update timeout

Files changed (1) hide show

app.py CHANGED Viewed

@@ -170,7 +170,7 @@ def run(
     ).to(device=model_12.device, dtype=torch.bfloat16)
     streamer = TextIteratorStreamer(
-        input_processor, skip_prompt=True, skip_special_tokens=True
     )
     generate_kwargs = dict(
         inputs,

     ).to(device=model_12.device, dtype=torch.bfloat16)
     streamer = TextIteratorStreamer(
+        input_processor, skip_prompt=True, skip_special_tokens=True, timeout=60.0
     )
     generate_kwargs = dict(
         inputs,