Commit History

RoPE cosine muon lr max 0.02 min 0.002 s18794 ppl 24.8575
b4ed9a0
verified

Jmushi commited on

alibi 17000 muon lr 0.02 0-12000 0.005 12000-16500 0.001 16500-17000 24.9336
08d211e
verified

Jmushi commited on

Upload 2 files
701bce8
verified

Jmushi commited on

Upload 2 files
5242554
verified

Jmushi commited on

Upload 2 files
c29c507
verified

Jmushi commited on

Upload checkpoint.pt with huggingface_hub
2bb6d2a
verified

Jmushi commited on

Upload model.py with huggingface_hub
5de0bd5
verified

Jmushi commited on

initial commit
920d79f
verified

evc010 commited on