Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ tags:
|
|
| 7 |
---
|
| 8 |
|
| 9 |
# Description
|
| 10 |
-
`
|
| 11 |
|
| 12 |
### Learned optimizer meta training and architectural details
|
| 13 |
| **Field** | **Value** |
|
|
@@ -96,7 +96,8 @@ print("Done!")
|
|
| 96 |
# Official Resources
|
| 97 |
|
| 98 |
- **Paper**: [VeLO: Training Versatile Learned Optimizers by Scaling Up](https://arxiv.org/abs/2211.09760)
|
| 99 |
-
- **
|
|
|
|
| 100 |
|
| 101 |
# Important Notes
|
| 102 |
|
|
|
|
| 7 |
---
|
| 8 |
|
| 9 |
# Description
|
| 10 |
+
`VeLO` is a learned optimizer meta-trained on thousands of diverse machine learning tasks. It corresponds to the VeLO (Versatile Learned Optimizer) from [VeLO: Training Versatile Learned Optimizers by Scaling Up](https://arxiv.org/abs/2211.09760).
|
| 11 |
|
| 12 |
### Learned optimizer meta training and architectural details
|
| 13 |
| **Field** | **Value** |
|
|
|
|
| 96 |
# Official Resources
|
| 97 |
|
| 98 |
- **Paper**: [VeLO: Training Versatile Learned Optimizers by Scaling Up](https://arxiv.org/abs/2211.09760)
|
| 99 |
+
- **Adapted from Repository**: [Google Learned Optimization](https://github.com/google/learned_optimization/tree/main/learned_optimization/research/general_lopt)
|
| 100 |
+
- **Available in PyLO** [PyLO] (https://github.com/Belilovsky-Lab/pylo)
|
| 101 |
|
| 102 |
# Important Notes
|
| 103 |
|