Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Fsoft-AIC
/
backup_checkpoints_libmoe
like
0
Follow
FPT Software AI Center
69
Image-Text-to-Text
TensorBoard
Safetensors
English
arxiv:
2411.00918
License:
apache-2.0
Model card
Files
Files and versions
xet
Metrics
Training metrics
Community
6187
refs/pr/191
backup_checkpoints_libmoe
/
sft
/
xmoe_665k_llava
/
checkpoint-16632
/
global_step16632
61.2 GB
1 contributor
History:
1 commit
DavidNguyen
Upload folder using huggingface_hub (
#12
)
8ba7391
verified
9 months ago
bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
15.3 GB
LFS
Upload folder using huggingface_hub (#12)
9 months ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (7)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch.FloatStorage"
,
"torch._tensor._rebuild_from_type_v2"
,
"torch.Tensor"
,
"torch._utils._rebuild_tensor_v2"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"collections.OrderedDict"
How to fix it?
15.3 GB
xet
Upload folder using huggingface_hub (#12)
9 months ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (7)
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch._utils._rebuild_tensor_v2"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._tensor._rebuild_from_type_v2"
,
"torch.Tensor"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
How to fix it?
15.3 GB
xet
Upload folder using huggingface_hub (#12)
9 months ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (7)
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch._utils._rebuild_tensor_v2"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._tensor._rebuild_from_type_v2"
,
"torch.Tensor"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
How to fix it?
15.3 GB
xet
Upload folder using huggingface_hub (#12)
9 months ago
zero_pp_rank_0_mp_rank_00_model_states.pt
pickle
Detected Pickle imports (5)
"__builtin__.set"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.BFloat16Storage"
,
"collections.OrderedDict"
,
"torch.Size"
How to fix it?
626 kB
xet
Upload folder using huggingface_hub (#12)
9 months ago
zero_pp_rank_1_mp_rank_00_model_states.pt
pickle
Detected Pickle imports (5)
"__builtin__.set"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.BFloat16Storage"
,
"collections.OrderedDict"
,
"torch.Size"
How to fix it?
626 kB
xet
Upload folder using huggingface_hub (#12)
9 months ago
zero_pp_rank_2_mp_rank_00_model_states.pt
pickle
Detected Pickle imports (5)
"__builtin__.set"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.BFloat16Storage"
,
"collections.OrderedDict"
,
"torch.Size"
How to fix it?
626 kB
xet
Upload folder using huggingface_hub (#12)
9 months ago
zero_pp_rank_3_mp_rank_00_model_states.pt
pickle
Detected Pickle imports (5)
"__builtin__.set"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.BFloat16Storage"
,
"collections.OrderedDict"
,
"torch.Size"
How to fix it?
626 kB
xet
Upload folder using huggingface_hub (#12)
9 months ago