Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
067dcb0
·
verified ·
1 Parent(s): 18a8b9f

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03d8a935cfe8396b41e3474490687c3ab5e080df3e3021b28be2fc2779c7a1ff
3
+ size 2513856385
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ae63a684bb6133411d661cb6dd396d9fc629af3a06947fbf52c3bfee4b13e68
3
+ size 50526
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cc6cce544ce64ea2c7429550e532152cb704d6d064049b45d02173b94260cfc
3
+ size 94430
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01ab4ecee53fe74d49be6e67ba8b8446282b6ac337638b8ce058f3c550b7c994
3
+ size 157854
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8861ab485fd3d8e2629e0c6ba2d7906d427d1a9d6717143975f7f5c0aab15552
3
+ size 83742
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3415ff62e44b6695ad328ec455744c9268d5e775fc33643192ddf6eb1559fa3e
3
+ size 256094
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6394dd935e8025d4128dad3066e7fc343587fc6ffabba1c2022ceec7b21dbef5
3
+ size 55326
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f12d18a4d05090221fc3a1e7df3d54f07c0204a0b85a81ebef8e561ef0a26c56
3
+ size 207838
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-157000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b562d15c1602b5ae0af8a7ee2e84814a486c8215fcf22af97f30dd6980529eb2
3
+ size 170782