Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
e942caf
·
verified ·
1 Parent(s): 2df032d

Upload intermediate checkpoint for Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C at iteration 78500

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/main.pt +3 -0
  2. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_0.pt +3 -0
  3. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_1.pt +3 -0
  4. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_2.pt +3 -0
  5. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_3.pt +3 -0
  6. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_4.pt +3 -0
  7. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_5.pt +3 -0
  8. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_6.pt +3 -0
  9. intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_7.pt +3 -0
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7da44cd0380a3686449b0fca1504b790be055fc84bf41eea02da3041f908f6b
3
+ size 6413955138
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb6054b5fd33838a3ef9a401043711135a00f42cb50bc840f48b23ce86480ac8
3
+ size 141278
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77383314861a9e2d6c1e78fa6a1876d11295636db9698605abf25083bd8d5dbe
3
+ size 70878
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28910e01b41e8e827793c42ab8af1ae4cec1d2f6623612aab8f483923697b4c9
3
+ size 61470
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07b2a01111520475ac5b1a55881ff2951cd44fbe5c1e35156dbc1ef7b174adbb
3
+ size 141854
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6180295d30e5d2fbaae03bc57c013680f28ed8f885ecc9b14327caa863a70620
3
+ size 80222
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecb12559d841912903882496ad22c57445f779f50ae95b4a1fe6ccfaafc0d0e6
3
+ size 26206
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29410ab4ab2c34b07f1e827cc647f28b718ed30cfb548072161bb17e4fc2fa2b
3
+ size 38558
intermediate-checkpoints/2C_8gpus/Resume_70650_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_2C/inter-ckpt-78500/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a91b6caf93187a59e29e55e2b7eeec81fa576081b663fc470e9e242144a5502
3
+ size 84446