File size: 2,415 Bytes
7b88703 |
1 2 3 4 5 6 7 |
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00, 2998.07it/s]
[2026-01-07 04:29:01,441] [WARNING] [axolotl.monkeypatch.multipack.patch_remote:85] [PID:48541] Failed to load model for multipack patching: Parameter.__new__() got an unexpected keyword argument '_is_hf_initialized'. Multipack _get_unpad_data patching will be skipped.
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00, 1452.57it/s]
[2026-01-07 04:33:39,857] [WARNING] [py.warnings._showwarnmsg:110] [PID:48541] /workspace/venv/lib/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:675: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html .
warnings.warn(
|