Final_Assignment_Template

Configuration error

oremaz commited on Jun 3

Commit

5d9f1a5

1 Parent(s): 0d47470

Update agent.py

Files changed (1) hide show

agent.py CHANGED Viewed

@@ -73,7 +73,7 @@ proj_llm = HuggingFaceLLM(
     tokenizer_name=model_id,
     device_map="auto",
     model_kwargs={"torch_dtype": "auto"},
-    max_new_tokens = 100000
     generate_kwargs={
         "temperature": 0.1,
         "top_p": 1.0

     tokenizer_name=model_id,
     device_map="auto",
     model_kwargs={"torch_dtype": "auto"},
+    max_new_tokens = 100000,
     generate_kwargs={
         "temperature": 0.1,
         "top_p": 1.0