Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
a761b1b
·
verified ·
1 Parent(s): 202e81a

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbd051f647c59f7d70871bec71f3a38912ecab0955b09a7dfa9c3cc765053e2a
3
+ size 2674684325
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9179b3190e6421636b5a06240492ea4be4b17b0a5e054709ade74b8aeba663f
3
+ size 128286
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8192b6ffeb2f27bd069141d0bb9bec05bbf66c4945ef8acef67a33e1c89185f3
3
+ size 61598