flash_attn installation error when running at Colab

#10

by vpmet - opened 10 days ago

I have tried to run the model in Colab but I get an error when installing required packages:
"It seems that the flash_attn package failed to install, which is a common issue due to its specific hardware and software dependencies (like CUDA and PyTorch versions)."

vpmet changed discussion status to closed 10 days ago

vpmet changed discussion status to open 10 days ago

Cathalobrien

ECMWF org 10 days ago

Hi @vpmet ,

The flash attention package typically has to be compiled from source. You can find some compilation instructions and the list of supported platforms here.

chdamianos

4 days ago

Hi @vpmet ,
Checkout https://github.com/mjun0812/flash-attention-prebuild-wheels/ for compiled flash_attn WHLs

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment