Higher-order Linear Attention
Paper
•
2510.27258
•
Published
•
14
Linear Attention
-
-
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper • 2503.14456 • Published • 153 -
xLSTM 7B: A Recurrent LLM for Fast and Efficient Inference
Paper • 2503.13427 • Published • 3 -
MoM: Linear Sequence Modeling with Mixture-of-Memories
Paper • 2502.13685 • Published • 36 -
Gated Delta Networks: Improving Mamba2 with Delta Rule
Paper • 2412.06464 • Published • 14 -
xLSTM: Extended Long Short-Term Memory
Paper • 2405.04517 • Published • 18 -
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper • 2402.19427 • Published • 56