Spaces:

ignitariumcloud
/

idefics2

Runtime error

arjunanand13 commited on May 2, 2024

Commit

24f8284

verified ·

1 Parent(s): 105e5a6

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -14,7 +14,7 @@ processor = AutoProcessor.from_pretrained("HuggingFaceM4/idefics2-8b")
 model = Idefics2ForConditionalGeneration.from_pretrained(
         "HuggingFaceM4/idefics2-8b",
         torch_dtype=torch.bfloat16,
-        _attn_implementation="flash_attention_2",
         # trust_remote_code=True
 ).to("cuda")

 model = Idefics2ForConditionalGeneration.from_pretrained(
         "HuggingFaceM4/idefics2-8b",
         torch_dtype=torch.bfloat16,
+        # _attn_implementation="flash_attention_2",
         # trust_remote_code=True
 ).to("cuda")