Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention Paper • 2606.20945 • Published 6 days ago • 42
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT Text Generation • 0.6B • Updated 24 days ago • 314 • 8
FrontiersMind/Nandi-Mini-V1.1-600M-Early-Checkpoint-250GT Text Generation • 0.6B • Updated 28 days ago • 514 • 11
ZClip: Adaptive Spike Mitigation for LLM Pre-Training Paper • 2504.02507 • Published Apr 3, 2025 • 90