| Flash-Attention  | Python Versions             | PyTorch Versions                    | CUDA Versions          |
|------------------|-----------------------------|-------------------------------------|------------------------|
| 2.7.4.post1      | 3.12                        | 2.8.0                               | 12.8.1                 |