Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
moderntalker
/
efficient_pretrain_checkpoints
like
0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
efficient_pretrain_checkpoints
/
intermediate-checkpoints
Ctrl+K
Ctrl+K
1 contributor
History:
115 commits
moderntalker
Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
c818d06
verified
about 22 hours ago
1C_2gpus
Upload intermediate checkpoint for Resume_35325_fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_1C at iteration 39250
about 1 month ago
1C_4gpus
Upload intermediate checkpoint for Resume_67911_warmup2000_fineweb_muon_lr1e-3_wd1e-4_bf16_grad_clip1e0_1C at iteration 75457
about 1 month ago
1C_8gpus
Upload intermediate checkpoint for Resume_67911_warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_1C at iteration 75457
about 1 month ago
2C_2gpus
Upload intermediate checkpoint for Resume_70650_fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_2C at iteration 78500
about 1 month ago
2C_4gpus
Upload intermediate checkpoint for warmup2000_fineweb_muon_lr1e-3_wd1e-4_bf16_grad_clip1e0_2C at iteration 150914
about 1 month ago
2C_8gpus
Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 150914
about 1 month ago
4C_2gpus
Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
about 1 month ago
4C_8gpus
Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 157000
about 22 hours ago
