This CUDA extension implements fused dropout + residual + LayerNorm from the flash-attention repo.
- Downloads last month
- 26
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
This CUDA extension implements fused dropout + residual + LayerNorm from the flash-attention repo.
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("danieldk/wrong-sha1", version=1)