Disentangling Representation Evolution in Transformers through Directional Decomposition Paper • 2609.15975 • Published 4 days ago • 4
What Matters in Transformers? Not All Attention is Needed Paper • 2406.15786 • Published Jun 22, 2024 • 33
Making Large Language Models Efficient Dense Retrievers Paper • 2512.20612 • Published Dec 23, 2025 • 5
LLM-Drop Collection Resources for studies on redundancy in LLMs, including layer dropping and representation-hierarchy-based pruning. • 16 items • Updated Jul 31 • 7
Understanding and Harnessing Sparsity in Unified Multimodal Models Paper • 2512.02351 • Published Dec 2, 2025 • 6
Demystifying When Pruning Works via Representation Hierarchies Paper • 2603.24652 • Published Apr 6 • 20