Spaces:

Uglevod7
/

Chek

Sleeping

Uglevod7 commited on Sep 17, 2024

Commit

3aa5ea0

verified ·

1 Parent(s): 3bb48f5

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -8,7 +8,7 @@ model_name_or_path = "TheBloke/Unholy-v1-12L-13B-GPTQ"
 # To use a different branch, change revision
 # For example: revision="main"
 model = AutoModelForCausalLM.from_pretrained(model_name_or_path,
-                                             device_map="cuda:0", #device_map="auto",
                                              trust_remote_code=False,
                                              revision="main")

 # To use a different branch, change revision
 # For example: revision="main"
 model = AutoModelForCausalLM.from_pretrained(model_name_or_path,
+                                             #device_map="cuda:0", #device_map="auto",
                                              trust_remote_code=False,
                                              revision="main")