| library_name: kernels | |
| tags: | |
| - kernels | |
| - rocm | |
| # Split-K W4A8 MoE GEMM (RDNA4/gfx1201) | |
| Split-K W4A8 fp8-WMMA MoE GEMM with atomic scatter. | |
| Built with [kernel-builder](https://github.com/huggingface/kernel-builder) for AMD RDNA4 (gfx1201). | |
| Load with the [`kernels`](https://github.com/huggingface/kernels) library: | |
| ```python | |
| from kernels import get_kernel | |
| kernel = get_kernel("pat883/moe-splitk-hip") | |
| ``` | |
| > Requires a ROCm PyTorch build (torch 2.10 / ROCm 7.x) on an RDNA4 card. Built variants: | |
| > `torch210-cxx11-rocm70` and `torch210-cxx11-rocm71`. | |