Spaces:

Malaclypse-AI
/

gemma-demo

Running on Zero

Malaclypse-AI commited on 14 days ago

Commit

d73facb

verified ·

1 Parent(s): c1dc25c

Strip special tokens for clean streamed output

Files changed (1) hide show

app.py CHANGED Viewed

@@ -122,7 +122,7 @@ def respond(
     streamer = TextIteratorStreamer(
         processor.tokenizer,
         skip_prompt=True,
-        skip_special_tokens=False,
     )
     do_sample = temperature > 0

     streamer = TextIteratorStreamer(
         processor.tokenizer,
         skip_prompt=True,
+        skip_special_tokens=True,
     )
     do_sample = temperature > 0