Buckets:
26.3 GB
188 files
Updated 14 days ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| benchmarks | 1 items | ||
| build | 184 items | ||
| .gitattributes | 1.56 kB xet | d3200ff1 | |
| README.md | 865 Bytes xet | 8807e806 | |
| benchmark.py | 317 Bytes xet | 50a9785a |
This is the repository card of kernels-community/flash-attn3 that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
How to use
# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel
kernel_module = get_kernel("kernels-community/flash-attn3", version=1)
flash_attn_combine = kernel_module.flash_attn_combine
flash_attn_combine(...)
Available functions
flash_attn_combineflash_attn_funcflash_attn_qkvpacked_funcflash_attn_varlen_funcflash_attn_with_kvcacheget_scheduler_metadata
Benchmarks
Benchmarking script is available for this kernel. Run kernels benchmark kernels-community/flash-attn3 --version 1.
- Total size
- 26.3 GB
- Files
- 188
- Last updated
- Aug 10
- Pre-warmed CDN
- US EU US EU