btherien commited on
Commit
ed5fb0c
·
verified ·
1 Parent(s): cce9a53

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -8,7 +8,7 @@ tags:
8
 
9
 
10
  # Description
11
- `btherien/mulo` is a leared optimizer meta-training im μ-parameterization. It corresponds to the $\mu$LO$_M$ optinzer of [μLO: Compute-Efficient Meta-Generalization of Learned Optimizers](https://arxiv.org/abs/2406.00153). Due to being meta-train in $\mu$P, $\mu$LO$_M$ has strong meta-generalization capabilities (abilitize to optimizer unseen tasks), despite its relatively short and inexpensive meta-training distirbution.
12
  ### Learned optimizer meta training and architectural details
13
  | **Field** | **Value** |
14
  |------------------------------|---------------------------------------------------------------------------|
 
8
 
9
 
10
  # Description
11
+ `btherien/mulo` is a learned optimizer meta-trained in μ-parameterization. It corresponds to the μLO_M optimizer from [μLO: Compute-Efficient Meta-Generalization of Learned Optimizers](https://arxiv.org/abs/2406.00153). Due to being meta-trained in μP, μLO_M has strong meta-generalization capabilities (i.e., the ability to optimize unseen tasks), despite its relatively short and inexpensive meta-training distribution.
12
  ### Learned optimizer meta training and architectural details
13
  | **Field** | **Value** |
14
  |------------------------------|---------------------------------------------------------------------------|