matilda-mini / src /matilda /train.py

Commit History

Add trained checkpoint: 3B tokens, loss=3.16, MFU=31.5%
5442313
verified

prometheus04 commited on

second review fixes
f4d2cf2
verified

prometheus04 commited on

Muon optimizer + README
3ac4183
verified

prometheus04 commited on

Matilda-Mini phases 1-5 + runbook
880f286
verified

prometheus04 commited on