Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
ad81935
·
verified ·
1 Parent(s): 941f81d

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 150914

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/main.pt +3 -0
  2. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_0.pt +3 -0
  3. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_1.pt +3 -0
  4. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_2.pt +3 -0
  5. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_3.pt +3 -0
  6. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_4.pt +3 -0
  7. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_5.pt +3 -0
  8. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_6.pt +3 -0
  9. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_7.pt +3 -0
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28ca3be5b7920a9a622a744c7b193cd1c637b89305b32f0fbdac71bd74314f55
3
+ size 14259865902
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddaf7459d56cbd1c7f8885881ff709ea6da950f4757d9644d349e651e3a93509
3
+ size 114206
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:633a503467abdfc665dbe247190c7decdbe6b70c1f029fbceeb69de1b312c56f
3
+ size 77982
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:927b54b8790155e67d06e9757c62f2f66b421e88f7083fe854e1adeac2452879
3
+ size 175390
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c74ce7e14a13f8504eee0db0abba35dd61316888d43ca1cb42f2839b74a0f9c
3
+ size 73310
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:553df4d9dfebed8cacbe0848aacdbe04fdee33487a79a7722a24ddc8910c02a1
3
+ size 286750
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:470d0f55e2851749dc0807126f0c9a987267ff9593450f61ec2bf3675e104786
3
+ size 63326
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aaef424e549f64d89c88b81aec05417e36287ae2e4d9666892745ef232ac5f7b
3
+ size 158622
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-150914/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c50eef3686d67f2c03d59e30f986c7f06da116021ee03b8696e4568a2f627e4
3
+ size 190686