Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
| sbatch -p ${SLURM_PARTITION} \ | |
| -A ${SLURM_ACCOUNT} \ | |
| --job-name=${JOB_NAME} \ | |
| --nodes=${NNODES} \ | |
| --export=MEGATRON_CODE_DIR,MEGATRON_PARAMS,DOCKER_MOUNT_DIR SRUN.sh | |
| exit 0 | |