Instructions to use kernels-community/layer_norm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/layer_norm with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/layer_norm") - Notebooks
- Google Colab
- Kaggle
update build
Browse files- build.toml +1 -0
build.toml
CHANGED
|
@@ -79,6 +79,7 @@ src = [
|
|
| 79 |
"layer-norm/ln_utils.cuh",
|
| 80 |
"layer-norm/static_switch.h"
|
| 81 |
]
|
|
|
|
| 82 |
cuda-flags = [
|
| 83 |
"-O3",
|
| 84 |
"-U__CUDA_NO_HALF_OPERATORS__",
|
|
|
|
| 79 |
"layer-norm/ln_utils.cuh",
|
| 80 |
"layer-norm/static_switch.h"
|
| 81 |
]
|
| 82 |
+
cxx-flags = ["-DFLASHATTENTION_DISABLE_PYBIND"]
|
| 83 |
cuda-flags = [
|
| 84 |
"-O3",
|
| 85 |
"-U__CUDA_NO_HALF_OPERATORS__",
|