SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Paper
•
2410.13276
•
Published
•
29
Dayou DU
Daniel-Duda
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 11 hours ago
HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing
upvoted
a
paper
8 months ago
SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
upvoted
a
paper
over 1 year ago
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via
Self-Distillation
Organizations
None yet
authored
a
paper
over 1 year ago