Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
941f81d
·
verified ·
1 Parent(s): e41b08a

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 100000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/main.pt +3 -0
  2. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_0.pt +3 -0
  3. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_1.pt +3 -0
  4. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_2.pt +3 -0
  5. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_3.pt +3 -0
  6. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_4.pt +3 -0
  7. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_5.pt +3 -0
  8. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_6.pt +3 -0
  9. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_7.pt +3 -0
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d48e0898181515f547154ff4069fc099e44a4629250a38ba3a88ada26c17ca97
3
+ size 14259865902
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:600622457d7d640d16fdab11ff37431ae251929771e2ec73189c6b1fd64834bc
3
+ size 256862
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dbe21bf2e446bb0b897cb7289c5edb802583679e5661b84cef4ecb512899f16
3
+ size 67742
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b2dd75f5ccc340be59193496cfdca86530f75495ae00991bd66d84cc69f0dd6
3
+ size 27614
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1c38f47a65e44fb0e25ad4c216a4b0903160866caf20af68dbcf06ad198f410
3
+ size 171166
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b96c9575a2555242db11ba6cc9065ad8de8963245c84b636ea9dd3e128f5f64
3
+ size 136030
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39fc16f6c1411d47bbe17f506ffad0c13803d0d60fb51852f2bcea199232eaa7
3
+ size 110046
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eeb61a5e8595de8f3910edb1e2ee256ad96f163778b017c3ad2e61b0efe8c24f
3
+ size 172382
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-100000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6ce5a7336ad717b405656db948d41ea142e3fab41f2ef37df966fbb2fdcd93f
3
+ size 33118