Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 79
🔄 In a Training Loop
Kuldip Patel
kp7742
AI & ML interests
GenAI, LLMs
Recent Activity
upvoted a paper 11 days ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention updated a model 9 months ago
kp7742/YALM-80M published a model 9 months ago
kp7742/YALM-80MOrganizations
None yet
upvoted a paper 11 days ago