prometheus04
/

matilda-mini

Model card Files Files and versions

matilda-mini / src

Commit History

Fix RoPE dtype cast for bfloat16 inference

9b5174f
verified

prometheus04 commited on May 28

Add trained checkpoint: 3B tokens, loss=3.16, MFU=31.5%

5442313
verified

prometheus04 commited on May 28

second review fixes

f4d2cf2
verified

prometheus04 commited on May 23

Muon optimizer + README

3ac4183
verified

prometheus04 commited on May 23

GPU-session fixes (RNG cpu, shard filter, cu124, 3090 config)

511257f
verified

prometheus04 commited on May 23

Matilda-Mini phases 1-5 + runbook

880f286
verified

prometheus04 commited on May 23