Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
moderntalker
/
efficient_pretrain_checkpoints
like
0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
efficient_pretrain_checkpoints
/
intermediate-checkpoints
/
4C_2gpus
61.2 GB
Ctrl+K
Ctrl+K
1 contributor
History:
25 commits
moderntalker
Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
a761b1b
verified
about 1 month ago
fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C
Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
about 1 month ago
fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C
Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
about 1 month ago
fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C
Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000
about 1 month ago
fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C
Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 157000
about 1 month ago