Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
2b464dd
·
verified ·
1 Parent(s): 1ade569

Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ed30d7e6ef359a78b457b92564172908d0970f6940d8f50490c728863fed77a
3
+ size 2485688825
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efcb0d4b8fb9b6795c7dbc337089519be7497dad75594cc6a829f0dcb5d289d3
3
+ size 128286
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-157000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79d8183e2f5c0479bb059d937281dd258c00c0f6036f3475eaf8c76488401fd7
3
+ size 61598