Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 62
Shashi Ranjan
shashiaiml
·
AI & ML interests
None yet
Recent Activity
upvoted a paper 2 days ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention upvoted a paper about 1 year ago
ZClip: Adaptive Spike Mitigation for LLM Pre-TrainingOrganizations
None yet