Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth
Paper • 2103.03404 • Published • 2
Yihe Dong
yihedong
AI & ML interests
None yet
Recent Activity
authored a paper 2 days ago
Attention is Not All You Need: Pure Attention Loses Rank Doubly
Exponentially with Depth authored a paper 2 days ago
LANISTR: Multimodal Learning from Structured and Unstructured Data authored a paper 2 days ago
Learned Feature Importance Scores for Automated Feature EngineeringOrganizations
None yet