Hugging Face's logo

Motif-Technologies
/
optimizer

Kernels
Model card Files
xet
 Community
9
optimizer

Commit History

Update tag
432fdf9
verified

danieldk HF Staff commited on

Merge pull request #14 from MotifTechnologies/fix_bug_in_fsdp
5458c82
unverified

TaehyunKim commited on

Add built binary [skip-build]
6ec5093

github-actions[bot] commited on

fix bug in fsdp
811726c

ca1207 commited on

feat(workflow): add Slack notifications for build start, success, and failure [skip-build] (#12)
0b8d958
unverified

wyldecat commited on

Merge pull request #11 from MotifTechnologies/ca1207-patch-1
53deea3
unverified

TaehyunKim commited on

Add built binary [skip-build]
de5bead

github-actions[bot] commited on

Update torch-ext/optimizer/muon.py
b0230e7
unverified

TaehyunKim commited on

Update torch-ext/optimizer/muon.py
ff2fcfb
unverified

TaehyunKim commited on

Update muon.py
c16b438
unverified

TaehyunKim commited on

Merge pull request #10 from MotifTechnologies/fix_a2a_gs_assert
4f71bc9
unverified

TaehyunKim commited on

Add built binary [skip-build]
aee4dc0

github-actions[bot] commited on

fix assert in a2a gather scatter
3dafb3e

ca1207 commited on

fix: use [skip-build] keyword to prevent build [skip-build]
94799ac

wyldecat commited on

Merge pull request #9 from MotifTechnologies/all2all_gather_scatter
1a3da4d
unverified

TaehyunKim commited on

Add built binary [ci skip]
e93bd1e

github-actions[bot] commited on

delete state in split_func
15336dc

ca1207 commited on

Add built binary [ci skip]
678578a

github-actions[bot] commited on

change owner_params to owned_params
6943c45

ca1207 commited on

modify pre step (overlap step) can get from arsgs
589b763

ca1207 commited on

add doc strings + init self rank on init_assign_params
267e8a0

ca1207 commited on

Add built binary [ci skip]
99af74f

github-actions[bot] commited on

Merge branch 'all2all_gather_scatter' of https://github.com/MotifTechnologies/optimizer into all2all_gather_scatter
37be0d0

ca1207 commited on

license added for flash_muon
d7cd571

ca1207 commited on

Add built binary [ci skip]
f88998f

github-actions[bot] commited on

apply pre-commit hook
fceb334

dongseokmotif commited on

consider multi node
39c42e0

dongseokmotif commited on

misc
35894d1

ca1207 commited on

use inpalce op in update_g
6e9baad

ca1207 commited on

use COMM_DTYPE instead of hardcoded dtype
2a8631f

ca1207 commited on

apply all2all scatter gather
ff6d675

ca1207 commited on

feat(muon_clip) : add muon clip (#6)
d65066c
unverified

dongseokmotif dongseokmotif github-actions[bot] commited on

chore: add nix build workflow (#8)
8997e30
unverified

wyldecat github-actions[bot] commited on

feat(muon) : add tuned-abc-values & blfoat16 communication
f7faa93

wyldecat commited on

feat: update muon to receive paramgroups, not model (#4)
b0f46c7
unverified

leejunhyeok junhyeok.lee wyldecat commited on

fix(muon): add update_p stage and dealloc tensors properly
99e7c0c

wyldecat commited on

feat(muon): add test for muon
3261444

wyldecat commited on

chore: add .gitignore
79fc8ba

wyldecat commited on

chore: add push-to-hf workflow
268d190

wyldecat commited on

Merge pull request #1 from MotifTechnologies/pre-commit_test_and_apply_lint
9d8a41d
unverified

TaehyunKim commited on

add pre commit action w/o pre-commit applied
80187d6

TaehyunKimMotif commited on

Update README.md
15b5d41
verified

JH-Motif commited on

fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value (#5)
671b033
verified

dongseokmotif commited on

Support HSDP (#4)
8447fd1
verified

iamwyldecat commited on

support torch 2.8 (#3)
1e2b528
verified

iamwyldecat commited on

fix(muon): handle un-distributed env
1f13dae

iamwyldecat commited on

refactor(muon): change argument adam_wd to weight_decay and handle params' type
02ac540

iamwyldecat commited on

fix(muon): free tensors that are no longer needed
64757cb

iamwyldecat commited on