---
license: apache-2.0
---

# Baseline First Run Checkpoint

FSDP checkpoint from training run global_step_264.

## Files

This repository contains FSDP sharded checkpoint files:
- model_world_size_8_rank_*.pt: Model weights sharded across 8 GPUs
- optim_world_size_8_rank_*.pt: Optimizer states
- extra_state_world_size_8_rank_*.pt: Extra training state
- fsdp_config.json: FSDP configuration
- huggingface/: Tokenizer and config files