Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
18a8b9f
·
verified ·
1 Parent(s): fdaa4f5

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 141300

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddaf4292be94b03ab737cebcd07f49b56e0383d6de71e0b624226cac39d32e02
3
+ size 2674684325
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d7e56f9a1cd9319c043b8bcd09609f1218bf225ddd3638a9efd64b69c12c46c
3
+ size 147742
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e258151bbe35d78b97251b9014e49045c298d26766231806cdfe6e91d8b737c8
3
+ size 31326
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c49dea4d336fa9c56f9469692294ebb52a57c5ce1df20bcf9ce023cbc9356c3
3
+ size 118814
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62dd98ca91dbb444c9d046c71c51d07d97df0ba3e48da9fb311bdf8fadbba4f6
3
+ size 62878
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62a572f6799b62a97049ed13411bfcb4373abb7b4bb6cce6ae5d6578353fcab5
3
+ size 89822
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29576df178b21f7d5715a8c2c0427ed7f1f1243ab8e534d74d958c8dcf1a0826
3
+ size 130782
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99a4a48ae3b1e926b821158399e12ab42482a84542a1ce0ef7bf594b7a88f179
3
+ size 94174
intermediate-checkpoints/4C_8gpus/fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17db53fe26a0d3a83193307b05d13bc2e06703ce38f57fa8ad3ac56abc00dc3b
3
+ size 120990