EveryonesGPT_Vision_Instruct

Running on Zero

HayatoHongoEveryonesAI commited on 28 days ago

Commit

a189686

1 Parent(s): f5e1816

updated

Files changed (2) hide show

__pycache__/inference.cpython-310.pyc DELETED Viewed

Binary file (1.44 kB)

vlm_inference.py CHANGED Viewed

@@ -170,10 +170,14 @@ def vlm_infer_stream(
     acc, last = [], ""
     for _ in range(max_new_tokens):
         tid = int(next_token.item())
         if tid in stop_ids:
             break
         acc.append(tid)
         text = tokenizer.decode(acc)
         if not text.endswith("�"):

     acc, last = [], ""
     for _ in range(max_new_tokens):
+        # sampled from prefill
         tid = int(next_token.item())
         if tid in stop_ids:
+            # ★ 最小修正：何も出ていないなら1回だけ表示
+            yield "[EOS]"
             break
         acc.append(tid)
         text = tokenizer.decode(acc)
         if not text.endswith("�"):