Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
Supported Models
Megatron Core supports a wide range of language and multimodal models with optimized implementations for large-scale training.
Model Conversion
For converting HuggingFace models to Megatron format, use Megatron Bridge, the official standalone converter. Megatron Bridge supports an extensive list of models including LLaMA, Mistral, Mixtral, Qwen, DeepSeek, Gemma, Phi, Nemotron, and many more.
See the Megatron Bridge supported models list for the complete and up-to-date list of supported models.
:maxdepth: 1
llms
multimodal
../llama_mistral