NeMo
Megatron-LM / docs /api-guide /internal /optimizer_param_scheduler.md
KexuanShi's picture
Upload folder using huggingface_hub
88e6849 verified
|
Raw
History Blame Contribute Delete
119 Bytes

Optimizer Parameters Scheduler

This api is used to calculate the learning rate and weight decay for the optimizer.