Spaces:

Chris4K
/

agent-reference-implemenation

Sleeping

Chris4K commited on Feb 9, 2024

Commit

da3ee0e

1 Parent(s): 84d493b

token

Files changed (1) hide show

model/custom_agent.py CHANGED Viewed

@@ -102,7 +102,7 @@ class CustomHfAgent(Agent):
     def format_prompt(self, task, chat_mode=False):
         checkpoint = "bigcode/starcoder"
-        tokenizer = AutoTokenizer.from_pretrained(checkpoint)
         #model = AutoModelForCausalLM.from_pretrained(checkpoint)  # You may want to use bfloat16 and/or move to GPU here

     def format_prompt(self, task, chat_mode=False):
         checkpoint = "bigcode/starcoder"
+        tokenizer = AutoTokenizer.from_pretrained(checkpoint, token = self.token)
         #model = AutoModelForCausalLM.from_pretrained(checkpoint)  # You may want to use bfloat16 and/or move to GPU here