gdn-hip / README.md

pat883

Add kernel card (library_name: kernels)

9080253 verified about 1 month ago

preview code

Raw

History Blame Contribute Delete

703 Bytes

metadata

library_name: kernels
tags:
  - kernels
  - rocm

GDN-HIP (Gated Delta Net, RDNA4/gfx1201)

Native HIP + rocWMMA kernels for the Gated Delta Net linear-attention path: gdn_prefill/decode (+wmma/chunked), causal_conv1d, gated RMSNorm, with native backward + differentiable training wrappers.

Built with kernel-builder for AMD RDNA4 (gfx1201). Load with the kernels library:

from kernels import get_kernel
kernel = get_kernel("pat883/gdn-hip")

Requires a ROCm PyTorch build (torch 2.10 / ROCm 7.x) on an RDNA4 card. Built variants: torch210-cxx11-rocm70 and torch210-cxx11-rocm71.