models/Megatron/docs/source/api-guide/optimizer_param_scheduler.rst

Optimizer Parameters Scheduler
==============================
This api is used to calculate the learning rate and weight decay for the optimizer.


Module contents
---------------

.. automodule:: core.optimizer_param_scheduler
   :members:
   :undoc-members:
   :show-inheritance: