Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
| diff --git a/setup.py b/setup.py | |
| index 63ce332..4e13462 100644 | |
| --- a/setup.py | |
| +++ b/setup.py | |
| if __name__ == '__main__': | |
| '-Wno-sign-compare', '-Wno-reorder', '-Wno-attributes'] | |
| nvcc_flags = ['-O3', '-Xcompiler', '-O3'] | |
| sources = ['csrc/deep_ep.cpp', 'csrc/kernels/runtime.cu', 'csrc/kernels/layout.cu', 'csrc/kernels/intranode.cu'] | |
| - include_dirs = ['csrc/'] | |
| + include_dirs = ['csrc/', '/usr/local/cuda/include/cccl/'] | |
| library_dirs = [] | |
| nvcc_dlink = [] | |
| extra_link_args = [] | |