Hugging Face's logo

Motif-Technologies
/
optimizer

Kernels
Model card Files
xet
Community
8
optimizer

Commit History

fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value
3356827
verified

dongseokmotif commited on

Support HSDP (#4)
8447fd1
verified

iamwyldecat commited on

support torch 2.8 (#3)
1e2b528
verified

iamwyldecat commited on

fix(muon): handle un-distributed env
1f13dae

iamwyldecat commited on

refactor(muon): change argument adam_wd to weight_decay and handle params' type
02ac540

iamwyldecat commited on

fix(muon): free tensors that are no longer needed
64757cb

iamwyldecat commited on

chore(muon): update comment
036642a

iamwyldecat commited on

chore(muon): clean build and update doc
febdf5b

iamwyldecat commited on

fix(muon): delete intermediate tensors immediately to lower peak mem usage
bdd2678

iamwyldecat commited on

chore: initial commit
8535e80

iamwyldecat commited on

initial commit
cf531ba
verified

iamwyldecat commited on