Ctrl+K
Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
c818d06 verified - Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C
- Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C
- fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C
- fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C
- fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C
- fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C
- fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C
- fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C