Low Rank Sparse Attention
Collection
Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated • 4
Jiaxing Wu
Mechmach
·
AI & ML interests
Mechanistic Interpretability
Organizations
None yet
upvoted a collection about 1 year ago