Hugging Face's logo

Spaces:
prithivMLmods
/
Multimodal-VLM-Thinking
Running on Zero

App Files Community
2
prithivMLmods commited on
Commit
9ea5aeb
·
verified ·
1 Parent(s): 745dec1

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -78,7 +78,7 @@ model_v4 = AutoModel.from_pretrained(
78
  MODEL_ID_V4,
79
  trust_remote_code=True,
80
  torch_dtype=torch.bfloat16,
81
- attn_implementation='flash_attention_2'
82
  ).eval().to(device)
83
  tokenizer_v4 = AutoTokenizer.from_pretrained(MODEL_ID_V4, trust_remote_code=True)
84
 
 
78
  MODEL_ID_V4,
79
  trust_remote_code=True,
80
  torch_dtype=torch.bfloat16,
81
+ attn_implementation='no_eager'
82
  ).eval().to(device)
83
  tokenizer_v4 = AutoTokenizer.from_pretrained(MODEL_ID_V4, trust_remote_code=True)
84