Low Rank Sparse Attention Collection Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". โข 3 items โข Updated Jul 11 โข 4