| tags: | |
| - kernel | |
| # fused_dense_lib | |
| Pre-built `fused_dense_lib` CUDA extension from `csrc/fused_dense_lib` of the | |
| [odysseyml/flash-attention](https://github.com/odysseyml/flash-attention) fork. | |
| Backs `flash_attn.modules.mlp.FusedMLP`: `linear_bias_wgrad`, `linear_act_forward`, `bias_act_linear_dgrad_bgrad`. | |
| No upstream wheels or community kernel exist for this extension, so the full | |
| torch/CUDA matrix is built by the fork's `build-fused-dense-matrix.yml` workflow | |
| (release `fused-dense-matrix-1`) and repackaged here in kernels layout. | |
| Build variants: torch 2.9–2.12 × cu126–cu132, x86_64 + aarch64, cp312. | |
| sm80/90 everywhere; +sm100/sm120 on cu128+. | |
| ```python | |
| from kernels import get_kernel | |
| fused_dense_lib = get_kernel("odyssey-systems/fused-dense-lib") | |
| ``` | |