Commit History

3 days ago

  1. 0.1B checkpoints from the MI300X session: llama_combined_lr1e3_step3000_seed0.pt

    Verified signature
    e66daa9
  2. 0.1B checkpoints from the MI300X session: llama_combined_step3000_seed0.pt

    Verified signature
    74e55dc
  3. 0.1B checkpoints from the MI300X session: exealm_combined_wakey_step3000_seed0.pt

    Verified signature
    1b7897f

6 days ago

  1. Overnight runs of 2026-11-12: the 18M model with gated attention and QK-norm (1.393 against 1.419), with the circuit search (1.431), the 0.1B model at step 3,000, the 8,000-step wide fine-tune, and their result files

    Verified signature
    ce2a9da