---
language:
- en
---

| Prebuilt Wheels                               | Python Versions | PyTorch Versions | CUDA Versions  | Source                                                                    |
|-----------------------------------------------|-----------------|------------------|----------------|---------------------------------------------------------------------------|
| Flash-Attention 2.7.4.post1                   | 3.12            | 2.8.0.dev        | 12.8.1         | [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention) |
| Flash-Attention 3 (pending official release)  | 3.12            | 2.8.0.dev        | 12.8.1         | INSERT |
| Sage-Attention 2++ (pending official release) | 3.12            | 2.8.0.dev        | 12.8.1         | INSERT |
| Sage-Attention 3 (pending official release)   | 3.12            | 2.8.0.dev        | 12.8.1         | INSERT |
| INSERT                                        | INSERT          | INSERT           | INSERT         | INSERT |