Instructions to use strangertoolshf/flash_attention_2_wheelhouse with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use strangertoolshf/flash_attention_2_wheelhouse with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("strangertoolshf/flash_attention_2_wheelhouse", device_map="auto") - Notebooks
- Google Colab
- Kaggle
add flash_attention_2 [torch2.9] - upload wheels ✅
#6
by prithivMLmods - opened
.gitattributes
CHANGED
|
@@ -82,3 +82,4 @@ wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.8/cu12/abiTRUE/cp312/flash_attn-
|
|
| 82 |
wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.8/cu12/abiTRUE/cp313/flash_attn-2.8.3+cu12torch2.8cxx11abiTRUE-cp313-cp313-linux_x86_64.whl filter=lfs diff=lfs merge=lfs -text
|
| 83 |
wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.8/cu12/abiTRUE/cp39/flash_attn-2.8.3+cu12torch2.8cxx11abiTRUE-cp39-cp39-linux_x86_64.whl filter=lfs diff=lfs merge=lfs -text
|
| 84 |
wheelhouse-flash_attn-2.8.3/linux_aarch64/torch2.9/cu12/abiTRUE/cp312/flash_attn-2.8.3+cu12torch2.9cxx11abiTRUE-cp312-cp312-linux_aarch64.whl filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 82 |
wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.8/cu12/abiTRUE/cp313/flash_attn-2.8.3+cu12torch2.8cxx11abiTRUE-cp313-cp313-linux_x86_64.whl filter=lfs diff=lfs merge=lfs -text
|
| 83 |
wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.8/cu12/abiTRUE/cp39/flash_attn-2.8.3+cu12torch2.8cxx11abiTRUE-cp39-cp39-linux_x86_64.whl filter=lfs diff=lfs merge=lfs -text
|
| 84 |
wheelhouse-flash_attn-2.8.3/linux_aarch64/torch2.9/cu12/abiTRUE/cp312/flash_attn-2.8.3+cu12torch2.9cxx11abiTRUE-cp312-cp312-linux_aarch64.whl filter=lfs diff=lfs merge=lfs -text
|
| 85 |
+
wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.9/cu12/cp312/flash_attn-2.8.3+cu12torch2.9cxx11abiTRUE-cp312-cp312-linux_x86_64.whl filter=lfs diff=lfs merge=lfs -text
|
wheelhouse-flash_attn-2.8.3/linux_x86_64/torch2.9/cu12/cp312/flash_attn-2.8.3+cu12torch2.9cxx11abiTRUE-cp312-cp312-linux_x86_64.whl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e2f9e39313266b1544b68138b15b91ee6221eccf14f7902b7c6620351340810
|
| 3 |
+
size 253780426
|