Spaces:

arcsu1
/

fine-tuned-models

Sleeping

arcsu1 commited on Aug 24, 2024

Commit

507cd03

1 Parent(s): 9b22fc3

update

Files changed (1) hide show

chatbot.py CHANGED Viewed

@@ -33,7 +33,7 @@ class ChatBot:
         attention_mask = torch.ones(inputs.shape, device=self.device)
         outputs = self.model.generate(
             inputs,
-            max_new_token=20,  # Adjust length as needed
             num_beams=5,
             early_stopping=True,
             no_repeat_ngram_size=2,

         attention_mask = torch.ones(inputs.shape, device=self.device)
         outputs = self.model.generate(
             inputs,
+            max_new_tokens=20,  # Adjust length as needed
             num_beams=5,
             early_stopping=True,
             no_repeat_ngram_size=2,