Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 62
abhay singh
singhaks
·
AI & ML interests
ai and ml
Recent Activity
upvoted a paper 2 days ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention liked a model 25 days ago
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT liked a model 30 days ago
FrontiersMind/Nandi-Mini-V1.1-600M-Early-Checkpoint-250GTOrganizations
None yet
upvoted a paper 2 days ago
upvoted an article 5 months ago
Article
Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance
tiiuae
• • 39 upvoted a paper about 1 year ago