Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling
Paper • 2607.02980 • Published • 36
🤝 Open to Collab
Lei ZHU
rayleizhu
·
AI & ML interests
Sparse Attention, Inference Acceleration, Algorithm-System Co-Design, Parallel Computing
Recent Activity
upvoted a paper about 17 hours ago
Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling submitted a paper about 17 hours ago
Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling upvoted an article 6 months ago
A failed experiment: Infini-Attention, and why we should keep trying?Organizations
None yet
upvoted a paper about 17 hours ago
upvoted an article 6 months ago
Article
A failed experiment: Infini-Attention, and why we should keep trying?
- +1
neuralink, lvwerra, thomwolf
• • 76