moderntalker
/

efficient_pretrain_checkpoints

Model card Files Files and versions

efficient_pretrain_checkpoints / intermediate-checkpoints /2C_8gpus

Commit History

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 150914

ad81935
verified

moderntalker commited on May 23

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 100000

941f81d
verified

moderntalker commited on May 23

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 67911

e41b08a
verified

moderntalker commited on May 22

Upload intermediate checkpoint for Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C at iteration 78500

e942caf
verified

moderntalker commited on May 22

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 25000

10a3ca1
verified

moderntalker commited on May 22