Commit History

  1. stage3_3b ckpt step 1000

    Verified signature
    a470c24
  2. stage3_3b ckpt step 500

    Verified signature
    5380a5b

  1. stage1 done

    Verified signature
    3315df2
  2. stage1: locked BPE-32768 (th 4x vs GPT-2)

    Verified signature
    f535130
  3. pin tao-finetune-huggingface-model to SFT stage with gate verdict

    Verified signature
    08004cc
  4. scaled init N(0,0.02) + residual 1/sqrt(2*depth), init loss 6.28 vs random 6.24

    Verified signature
    14c9d16
  5. add full 13.86B pretraining plan with cost math

    Verified signature
    3365bb8
  6. remove pycache

    Verified signature
    49a75c6
  7. FABER-Genesis-A100-Max 13.86B architecture: config + HF modeling + profiles + benchmark harness

    Verified signature
    2ffbf1f
  8. initial commit

    Verified signature
    0b7def2