Kernels:

---

kernels-community

/

rotary

like 0

Follow

kernels-community 432

Trusted publisher

---
license: bsd-3-clause
tags:
  - kernels
---

![Status](https://hubwebhook.dholtz.com/shield?repo=kernels-community/rotary)

## rotary

rotary embedding kernel from [Flash Attention](https://github.com/Dao-AILab/flash-attention/tree/main/csrc/rotary).

Kernel source: https://github.com/huggingface/kernels-community/tree/main/rotary