MassAlloc Attention: Let Attention Allocate Its Own Compute Paper • 2609.32712 • Published Sep 26 • 26
CoWindow Attention: Full Causal Coverage Is a Collective Property Paper • 2609.32704 • Published Sep 26 • 18
view article Article Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models wubingheng • Aug 5, 2025 • 7
Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architecture Paper • 2412.11834 • Published Dec 16, 2024 • 8
Cheems: Wonderful Matrices More Efficient and More Effective Architecture Paper • 2407.16958 • Published Jul 24, 2024 • 4