| --- |
| language: |
| - en |
| --- |
| |
| | Prebuilt Wheels | Python Versions | PyTorch Versions | CUDA Versions | Source | |
| |-----------------------------|-----------------|------------------|----------------|---------------------------------------------------------------------------| |
| | Flash-Attention 2.7.4.post1 | 3.12 | 2.8.0 | 12.8.1 | [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention) | |
| | Flash-Attention 3 (pending official release) | 3.12 | 2.8.0 | 12.8.1 | INSERT | |
| | Sage-Attention 2++ (pending approval) | 3.12 | 2.8.0 | 12.8.1 | INSERT | |
| | Sage-Attention 3 (pending official release) | 3.12 | 2.8.0 | 12.8.1 | INSERT | |
| | INSERT | 3.12 | 2.8.0 | 12.8.1 | INSERT | |
|
|
