| license: apache-2.0 | |
| # Baseline First Run Checkpoint | |
| FSDP checkpoint from training run global_step_264. | |
| ## Files | |
| This repository contains FSDP sharded checkpoint files: | |
| - model_world_size_8_rank_*.pt: Model weights sharded across 8 GPUs | |
| - optim_world_size_8_rank_*.pt: Optimizer states | |
| - extra_state_world_size_8_rank_*.pt: Extra training state | |
| - fsdp_config.json: FSDP configuration | |
| - huggingface/: Tokenizer and config files | |