Kernels:
Trusted publisher
Commit ·
ae4579c
1
Parent(s): 9e7d769
Uploaded using `kernel-builder`. (#3)
Browse files- Uploaded using `kernel-builder`. (f57797e14696f494be6de759f3aa344104adfae4)
Co-authored-by: Kernels Bot <kernels-bot@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -3,7 +3,7 @@ library_name: kernels
|
|
| 3 |
license: mit
|
| 4 |
---
|
| 5 |
|
| 6 |
-
This is the repository card of
|
| 7 |
|
| 8 |
## How to use
|
| 9 |
|
|
@@ -11,7 +11,7 @@ This is the repository card of kernels-community/aiter-flash-attn that has been
|
|
| 11 |
# make sure `kernels` is installed: `pip install -U kernels`
|
| 12 |
from kernels import get_kernel
|
| 13 |
|
| 14 |
-
kernel_module = get_kernel("
|
| 15 |
flash_attn_func = kernel_module.flash_attn_func
|
| 16 |
|
| 17 |
flash_attn_func(...)
|
|
|
|
| 3 |
license: mit
|
| 4 |
---
|
| 5 |
|
| 6 |
+
This is the repository card of amd/aiter-flash-attn that has been pushed on the Hub. It was built to be used with the [`kernels` library](https://github.com/huggingface/kernels). This card was automatically generated.
|
| 7 |
|
| 8 |
## How to use
|
| 9 |
|
|
|
|
| 11 |
# make sure `kernels` is installed: `pip install -U kernels`
|
| 12 |
from kernels import get_kernel
|
| 13 |
|
| 14 |
+
kernel_module = get_kernel("amd/aiter-flash-attn", version=2)
|
| 15 |
flash_attn_func = kernel_module.flash_attn_func
|
| 16 |
|
| 17 |
flash_attn_func(...)
|