UMoE: Unifying Attention and FFN with Shared Experts
Paper • 2505.07260 • Published • 10
MicroTest007
community
AI & ML interests
None defined yet.
ysngkil
authored a
paper about 1 year ago
ysngkil
authored 3
papers over 1 year ago
Enabling Intelligent Interactions between an Agent and an LLM: A Reinforcement Learning Approach
Paper • 2306.03604 • Published • 1
Enhancing Efficiency in Sparse Models with Sparser Selection
Paper • 2403.18926 • Published
Once is Enough: A Light-Weight Cross-Attention for Fast Sentence Pair Modeling
Paper • 2210.05261 • Published
CurioChen
updated 2
Spaces almost 2 years ago