docs/user-guide/features/index.md

Advanced Features

Advanced feature guides for key Megatron Core capabilities.

:maxdepth: 2

moe
context_parallel
custom_fsdp
dist_optimizer
optimizer_cpu_offload
pipeline_parallel_layout
tokenizers
megatron_energon
megatron_rl