| Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 20%|███████████████▊ | 1/5 [00:03<00:13, 3.26s/it] Loading checkpoint shards: 40%|███████████████████████████████▌ | 2/5 [00:07<00:11, 3.81s/it] Loading checkpoint shards: 60%|███████████████████████████████████████████████▍ | 3/5 [00:10<00:07, 3.60s/it] Loading checkpoint shards: 80%|███████████████████████████████████████████████████████████████▏ | 4/5 [00:15<00:03, 3.85s/it] Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████| 5/5 [00:18<00:00, 3.67s/it] Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████| 5/5 [00:18<00:00, 3.68s/it] | |
| [2025-10-10 17:12:08,966] [WARNING] [py.warnings._showwarnmsg:110] [PID:11351] /root/miniconda3/envs/py3.11/lib/python3.11/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:680: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . | |
| warnings.warn( | |