---
library_name: kernels
tags:
- kernels
- rocm
---

# MoE Token Alignment (RDNA4/gfx1201)

MoE block-aligned expert-sort (moe_align) native HIP kernel.

Built with [kernel-builder](https://github.com/huggingface/kernel-builder) for AMD RDNA4 (gfx1201).
Load with the [`kernels`](https://github.com/huggingface/kernels) library:

```python
from kernels import get_kernel
kernel = get_kernel("pat883/moe-hip")
```

> Requires a ROCm PyTorch build (torch 2.10 / ROCm 7.x) on an RDNA4 card. Built variants:
> `torch210-cxx11-rocm70` and `torch210-cxx11-rocm71`.