Spaces:

ARCQUB
/

BPMN-entity-extractor

Sleeping

ARCQUB commited on Mar 31

Commit

d6daf6b

verified ·

1 Parent(s): 6c0c37c

Update models/qwen.py

Files changed (1) hide show

models/qwen.py CHANGED Viewed

@@ -10,8 +10,8 @@ from transformers import Pix2StructForConditionalGeneration, Pix2StructProcessor
 model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
     "Qwen/Qwen2.5-VL-7B-Instruct",
     torch_dtype=torch.bfloat16,
-    device_map="cuda",
-    attn_implementation="flash_attention_2"
 )
 min_pixels = 256 * 28 * 28

 model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
     "Qwen/Qwen2.5-VL-7B-Instruct",
     torch_dtype=torch.bfloat16,
+    device_map="cuda"
+    #attn_implementation="flash_attention_2"
 )
 min_pixels = 256 * 28 * 28