fix init

fix(muon): add update_p stage and dealloc tensors properly

feat(muon): add test for muon

chore: add .gitignore

chore: add push-to-hf workflow

add more exclude files

Merge pull request #1 from MotifTechnologies/pre-commit_test_and_apply_lint

applied lint

add pre commit action w/o pre-commit applied

Update README.md

fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value (#5)

Support HSDP (#4)

support torch 2.8 (#3)

fix(muon): handle un-distributed env

refactor(muon): change argument adam_wd to weight_decay and handle params' type

fix(muon): free tensors that are no longer needed

chore(muon): update comment

chore(muon): clean build and update doc

fix(muon): delete intermediate tensors immediately to lower peak mem usage

chore: initial commit

initial commit