Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
efficient_pretrain_checkpoints

Commit History

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
c818d06
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
067dcb0
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 141300
18a8b9f
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300
fdaa4f5
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 100000
85caaca
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
afc6714
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
ae7ace4
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300
88979af
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300
c29369e
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000
30e423b
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 70650
b4463b9
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 50000
f625a35
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000
f4423d2
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000
ac2e10a
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 35325
b818caf
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650
e585009
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 15000
f03a2d3
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650
73104e2
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650
248d9ef
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000
6860e0e
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000
58fbced
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000
4408b01
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325
c4b3088
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325
1894e42
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325
81abebc
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 35325
09e5ef9
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000
b79a646
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000
815e1a3
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 15000
c443f8b
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000
060a0b4
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
65ce22a
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
98d065d
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300
46b4f16
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300
8fa231f
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000
bf19381
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000
5fa8f13
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650
fce2793
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650
d936480
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000
9ed9fd4
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000
15646e2
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325
365802e
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325
f632a84
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000
3a28804
verified

moderntalker commited on

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000
d43fabc
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 157000
c46d0ff
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 141300
fac70f2
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 100000
8ffa37d
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 70650
1d56c8a
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 50000
985ab08
verified

moderntalker commited on

Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 35325
58f6a60
verified

moderntalker commited on