Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
| # Advanced Features | |
| Advanced feature guides for key Megatron Core capabilities. | |
| ```{toctree} | |
| :maxdepth: 2 | |
| moe | |
| context_parallel | |
| custom_fsdp | |
| dist_optimizer | |
| optimizer_cpu_offload | |
| pipeline_parallel_layout | |
| tokenizers | |
| megatron_energon | |
| megatron_rl | |
| ``` | |