Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
48
Zhenghao Lin
Lin0
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
2 months ago
DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
upvoted
a
paper
4 months ago
Knocking-Heads Attention
Organizations
None yet
authored
a
paper
about 1 year ago
authored
a
paper
almost 2 years ago