Kernels
kernels-bot commited on
Commit
2bbbec1
·
verified ·
1 Parent(s): 151a7bd

Uploaded using `kernel-builder`.

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: kernels
3
+ license: bsd-3-clause
4
+ ---
5
+
6
+ This is the repository card of kernels-community/flash-attn3 that has been pushed on the Hub. It was built to be used with the [`kernels` library](https://github.com/huggingface/kernels). This card was automatically generated.
7
+
8
+ ## How to use
9
+
10
+ ```python
11
+ # make sure `kernels` is installed: `pip install -U kernels`
12
+ from kernels import get_kernel
13
+
14
+ kernel_module = get_kernel("kernels-community/flash-attn3", version=1)
15
+ flash_attn_combine = kernel_module.flash_attn_combine
16
+
17
+ flash_attn_combine(...)
18
+ ```
19
+
20
+ ## Available functions
21
+ - `flash_attn_combine`
22
+ - `flash_attn_func`
23
+ - `flash_attn_qkvpacked_func`
24
+ - `flash_attn_varlen_func`
25
+ - `flash_attn_with_kvcache`
26
+ - `get_scheduler_metadata`
27
+
28
+ ## Benchmarks
29
+
30
+ Benchmarking script is available for this kernel. Run `kernels benchmark kernels-community/flash-attn3 --version 1`.