Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
| FROM nvcr.io/nvidia/pytorch:24.02-py3 | |
| RUN apt update && \ | |
| apt -y upgrade && \ | |
| apt install -y --no-install-recommends \ | |
| software-properties-common \ | |
| build-essential \ | |
| python3-pip \ | |
| python3-dev \ | |
| bash \ | |
| git \ | |
| vim \ | |
| tmux \ | |
| python-is-python3 \ | |
| default-jre | |
| RUN pip install --upgrade pip | |
| RUN pip install einops einops-exts sentencepiece braceexpand webdataset packaging | |
| RUN pip install transformers datasets accelerate timm | |
| RUN pip install pytest-cov pytest_mock nltk wrapt | |
| RUN pip install zarr "tensorstore==0.1.45" | |
| RUN pip install black isort click==8.0.2 | |
| RUN pip install pycocoevalcap megatron-energon mistral-common tiktoken | |
| RUN pip install git+https://github.com/openai/CLIP.git | |
| # Use --no-deps for the following to avoid outdated and unnecessary dependencies. | |
| RUN pip install open_clip_torch open-flamingo[eval] --no-deps | |