File size: 944 Bytes
b30cc12
 
 
 
 
 
 
8f45c92
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
---
language:
- en
---

| Prebuilt Wheels             | Python Versions | PyTorch Versions | CUDA Versions  | Source                                                                    |
|-----------------------------|-----------------|------------------|----------------|---------------------------------------------------------------------------|
| Flash-Attention 2.7.4.post1 | 3.12            | 2.8.0            | 12.8.1         | [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention) |
| Flash-Attention 3 (pending official release)         | 3.12            | 2.8.0            | 12.8.1         | INSERT |
| Sage-Attention 2++ (pending approval)         | 3.12            | 2.8.0            | 12.8.1         | INSERT |
| Sage-Attention 3 (pending official release)         | 3.12            | 2.8.0            | 12.8.1         | INSERT |
| INSERT         | 3.12            | 2.8.0            | 12.8.1         | INSERT |