Spaces:

prithivMLmods
/

Molmo2-HF-Demo

Running on Zero

prithivMLmods commited on Feb 14

Commit

545f022

verified ·

1 Parent(s): 94f207c

update [kernels:flash-attn2] (cleaned) ✅

Files changed (1) hide show

app.py CHANGED Viewed

@@ -86,6 +86,7 @@ MODEL_ID = "allenai/Molmo2-8B"
 print(f"Loading {MODEL_ID}...")
 processor = AutoProcessor.from_pretrained(
     MODEL_ID,
     trust_remote_code=True,
     dtype="auto",
     device_map="auto"

 print(f"Loading {MODEL_ID}...")
 processor = AutoProcessor.from_pretrained(
     MODEL_ID,
+    attn_implementation="kernels-community/flash-attn2",
     trust_remote_code=True,
     dtype="auto",
     device_map="auto"