Article
A Review on the Evolvement of Load Balancing Strategy in MoE LLMs: Pitfalls and Lessons
•
28
Haoze He
HectorHe
AI & ML interests
LLMSys, LLM, MLSys
Recent Activity
published
a model
24 days ago
HectorHe/gpt-oss-20b-math7k-1epoch-lr4e-5-1e-4-gamma-part2
published
a model
about 2 months ago
HectorHe/Deepseek-V2-13B-Math7K-Expert-Enhance-Fix-Expert-Dense-32-experts
liked
a model
3 months ago
HectorHe/DeepSeek-V2-Lite-aux-free-sft-commonsense-1epoch-1e-5-gamma-share-expert
Organizations
upvoted
an
article
3 months ago