Spaces:

simonzhang5429
/

test3

Sleeping

simonzhang5429 commited on May 12, 2024

Commit

2db5dc7

verified ·

1 Parent(s): 1ca9d6d

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -8,8 +8,7 @@ model = AutoModelForCausalLM.from_pretrained(
     TOKENIZER_REPO,
     device_map="auto",
     local_files_only=True,
-    torch_dtype=torch.bfloat16,
-    attn_implementation="flash_attention_2"
 )

     TOKENIZER_REPO,
     device_map="auto",
     local_files_only=True,
+    torch_dtype=torch.bfloat16
 )