Spaces:

CodeForPakistan
/

GovernmentGPT

Runtime error

NLPGenius commited on Mar 18, 2025

Commit

4f5a01c

verified ·

1 Parent(s): c2d4cf1

Update flask_app.py

Files changed (1) hide show

flask_app.py CHANGED Viewed

@@ -8,7 +8,7 @@ import torch
 # Load your tokenizer and model
 tokenizer = AutoTokenizer.from_pretrained("NLPGenius/GovGPT-llama3")
 model = AutoModelForCausalLM.from_pretrained("NLPGenius/GovGPT-llama3",
-                                             torch_dtype=torch.bfloat16,
                                              device_map="auto",)

 # Load your tokenizer and model
 tokenizer = AutoTokenizer.from_pretrained("NLPGenius/GovGPT-llama3")
 model = AutoModelForCausalLM.from_pretrained("NLPGenius/GovGPT-llama3",
+                                             #torch_dtype=torch.bfloat16,
                                              device_map="auto",)