Phase-Technologies
/

forge-3b-pretrain

Model card Files Files and versions

forge-3b-pretrain / phase0_step0 /global_step0

1.49 GB

Ctrl+K

Ctrl+K

1 contributor

History: 7 commits

Phase-Technologies's picture

Phase-Technologies

Upload folder using huggingface_hub

e3951dd verified about 1 month ago

bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage"
How to fix it?
994 MB
xet

Upload folder using huggingface_hub about 1 month ago
mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "torch.BFloat16Storage"
How to fix it?
497 MB
xet

Upload folder using huggingface_hub about 1 month ago
zero_pp_rank_0_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.BFloat16Storage"
How to fix it?
172 kB
xet

Upload folder using huggingface_hub about 1 month ago