Muon Makes the First Mixture-of-Experts Layer Harder to Balance
Paper • 2610.37914 • Published
Marcos Hernanz
marcoshernanz
·
AI & ML interests
None yet
Recent Activity
authored a paper about 7 hours ago
Muon Makes the First Mixture-of-Experts Layer Harder to Balance updated a dataset about 9 hours ago
marcoshernanz/llm-lab-fineweb-edu-sample10bt-bpe-16384-full updated a dataset about 9 hours ago
marcoshernanz/tfg-runsOrganizations
authored a
paper about 7 hours ago
updated 2
datasets about 9 hours ago
published a
dataset 17 days ago
published a
dataset 7 months ago
updated a
dataset 7 months ago
published 2
datasets 7 months ago