Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
KexuanShi
/
Megatron-LM
like
0
NeMo
arxiv:
2406.07887
arxiv:
1909.08053
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
Use this model
Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
Libraries
NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
Notebooks
Google Colab
Kaggle
main
Megatron-LM
/
megatron
/
core
/
optimizer
1.48 MB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
KexuanShi
Upload folder using huggingface_hub
88e6849
verified
about 2 months ago
__pycache__
Upload folder using huggingface_hub
about 2 months ago
cpu_offloading
Upload folder using huggingface_hub
about 2 months ago
__init__.py
32.9 kB
Upload folder using huggingface_hub
about 2 months ago
clip_grads.py
9.87 kB
Upload folder using huggingface_hub
about 2 months ago
distrib_optimizer.py
126 kB
Upload folder using huggingface_hub
about 2 months ago
grad_scaler.py
5.16 kB
Upload folder using huggingface_hub
about 2 months ago
layer_wise_optimizer.py
15 kB
Upload folder using huggingface_hub
about 2 months ago
muon.py
13.5 kB
Upload folder using huggingface_hub
about 2 months ago
optimizer.py
68.3 kB
Upload folder using huggingface_hub
about 2 months ago
optimizer_config.py
20.2 kB
Upload folder using huggingface_hub
about 2 months ago
pion.py
37.3 kB
Upload folder using huggingface_hub
about 2 months ago
pion_2order.py
56 kB
Upload folder using huggingface_hub
about 2 months ago
pion_mha.py
29.8 kB
Upload folder using huggingface_hub
about 2 months ago
pion_muon.py
20 kB
Upload folder using huggingface_hub
about 2 months ago
pion_prev.py
37.6 kB
Upload folder using huggingface_hub
about 2 months ago
pion_prev_2.py
27.9 kB
Upload folder using huggingface_hub
about 2 months ago
pion_scaling.py
27.2 kB
Upload folder using huggingface_hub
about 2 months ago
pion_with12order.py
32.7 kB
Upload folder using huggingface_hub
about 2 months ago
qk_clip.py
1.53 kB
Upload folder using huggingface_hub
about 2 months ago
