rajammanabrolu
/

gpt-4-chat-debug

Model card Files Files and versions

rajammanabrolu commited on Nov 30, 2023

Commit

ebaaf48

·

1 Parent(s): 0778026

Update tiktoken.py

Files changed (1) hide show

tiktoken.py +1 -1

tiktoken.py CHANGED Viewed

@@ -185,7 +185,7 @@ class TiktokenTokenizerWrapper(PreTrainedTokenizer):
         template = template.replace(
             'USE_DEFAULT_PROMPT',
             'true' if self.use_default_system_prompt else 'false')
-        template = temp.replace(
             'ADD_GENERATION_PROMPT',
             'true' if self.add_generation_prompt else 'false'
         )

         template = template.replace(
             'USE_DEFAULT_PROMPT',
             'true' if self.use_default_system_prompt else 'false')
+        template = template.replace(
             'ADD_GENERATION_PROMPT',
             'true' if self.add_generation_prompt else 'false'
         )