Spaces:

CodeForPakistan
/

GovernmentGPT

Runtime error

NLPGenius commited on Feb 27, 2025

Commit

cb617d4

verified ·

1 Parent(s): a25aa68

Update flask_app.py

Files changed (1) hide show

flask_app.py CHANGED Viewed

@@ -8,7 +8,7 @@ import torch
 # Load your tokenizer and model
 tokenizer = AutoTokenizer.from_pretrained("NLPGenius/GovGPT-llama3")
 model = AutoModelForCausalLM.from_pretrained("NLPGenius/GovGPT-llama3",
-                                             #torch_dtype=torch.bfloat16,
                                              device_map="auto",)

 # Load your tokenizer and model
 tokenizer = AutoTokenizer.from_pretrained("NLPGenius/GovGPT-llama3")
 model = AutoModelForCausalLM.from_pretrained("NLPGenius/GovGPT-llama3",
+                                             torch_dtype=torch.bfloat16,
                                              device_map="auto",)