Add global_step_120
ddc4c50 verified - huggingface Add global_step_120
extra_state_world_size_8_rank_0.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_1.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_2.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_3.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_4.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_5.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_6.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 extra_state_world_size_8_rank_7.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
15.1 kB Add global_step_120 - 46 Bytes Add global_step_120
model_world_size_8_rank_0.pt Detected Pickle imports (15)
- "torch.distributed.tensor.placement_types.Shard",
- "torch.device",
- "torch.FloatStorage",
- "torch.serialization._get_layout",
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.DTensor",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec"
How to fix it?
4.1 GB Add global_step_120 - 4.1 GB Add global_step_120
model_world_size_8_rank_2.pt Detected Pickle imports (15)
- "torch.device",
- "torch.float32",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.distributed.tensor.DTensor",
- "torch.IntStorage",
- "torch.serialization._get_layout",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_wrapper_subclass"
How to fix it?
4.1 GB Add global_step_120 model_world_size_8_rank_3.pt Detected Pickle imports (15)
- "torch.device",
- "torch.float32",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.distributed.tensor.DTensor",
- "torch.IntStorage",
- "torch.serialization._get_layout",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_wrapper_subclass"
How to fix it?
4.1 GB Add global_step_120 model_world_size_8_rank_4.pt Detected Pickle imports (15)
- "torch.distributed.tensor.placement_types.Shard",
- "torch.device",
- "torch.FloatStorage",
- "torch.serialization._get_layout",
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.DTensor",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec"
How to fix it?
4.1 GB Add global_step_120 model_world_size_8_rank_5.pt Detected Pickle imports (15)
- "torch.device",
- "torch.float32",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.distributed.tensor.DTensor",
- "torch.IntStorage",
- "torch.serialization._get_layout",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_wrapper_subclass"
How to fix it?
4.1 GB Add global_step_120 model_world_size_8_rank_6.pt Detected Pickle imports (15)
- "torch.distributed.tensor.placement_types.Shard",
- "torch.device",
- "torch.FloatStorage",
- "torch.serialization._get_layout",
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.DTensor",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec"
How to fix it?
4.1 GB Add global_step_120 model_world_size_8_rank_7.pt Detected Pickle imports (15)
- "torch.distributed.tensor.placement_types.Shard",
- "torch.device",
- "torch.FloatStorage",
- "torch.serialization._get_layout",
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.DTensor",
- "torch.Size",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec"
How to fix it?
4.1 GB Add global_step_120 - 8.19 GB Add global_step_120
optim_world_size_8_rank_1.pt Detected Pickle imports (13)
- "__builtin__.dict",
- "__builtin__.long",
- "typing.Any",
- "__builtin__.list",
- "collections.defaultdict",
- "omegaconf.dictconfig.DictConfig",
- "omegaconf.nodes.AnyNode",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "omegaconf.listconfig.ListConfig",
- "torch._utils._rebuild_tensor_v2",
- "omegaconf.base.Metadata"
How to fix it?
8.19 GB Add global_step_120 optim_world_size_8_rank_2.pt Detected Pickle imports (13)
- "__builtin__.list",
- "omegaconf.dictconfig.DictConfig",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "typing.Any",
- "omegaconf.listconfig.ListConfig",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "__builtin__.dict",
- "__builtin__.long",
- "omegaconf.base.Metadata",
- "collections.defaultdict",
- "omegaconf.nodes.AnyNode"
How to fix it?
8.19 GB Add global_step_120 optim_world_size_8_rank_3.pt Detected Pickle imports (13)
- "__builtin__.dict",
- "__builtin__.long",
- "typing.Any",
- "__builtin__.list",
- "collections.defaultdict",
- "omegaconf.dictconfig.DictConfig",
- "omegaconf.nodes.AnyNode",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "omegaconf.listconfig.ListConfig",
- "torch._utils._rebuild_tensor_v2",
- "omegaconf.base.Metadata"
How to fix it?
8.19 GB Add global_step_120 optim_world_size_8_rank_4.pt Detected Pickle imports (13)
- "__builtin__.list",
- "omegaconf.dictconfig.DictConfig",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "typing.Any",
- "omegaconf.listconfig.ListConfig",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "__builtin__.dict",
- "__builtin__.long",
- "omegaconf.base.Metadata",
- "collections.defaultdict",
- "omegaconf.nodes.AnyNode"
How to fix it?
8.19 GB Add global_step_120 optim_world_size_8_rank_5.pt Detected Pickle imports (13)
- "__builtin__.list",
- "omegaconf.dictconfig.DictConfig",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "typing.Any",
- "omegaconf.listconfig.ListConfig",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "__builtin__.dict",
- "__builtin__.long",
- "omegaconf.base.Metadata",
- "collections.defaultdict",
- "omegaconf.nodes.AnyNode"
How to fix it?
8.19 GB Add global_step_120 optim_world_size_8_rank_6.pt Detected Pickle imports (13)
- "__builtin__.dict",
- "__builtin__.long",
- "typing.Any",
- "__builtin__.list",
- "collections.defaultdict",
- "omegaconf.dictconfig.DictConfig",
- "omegaconf.nodes.AnyNode",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "omegaconf.listconfig.ListConfig",
- "torch._utils._rebuild_tensor_v2",
- "omegaconf.base.Metadata"
How to fix it?
8.19 GB Add global_step_120 optim_world_size_8_rank_7.pt Detected Pickle imports (13)
- "__builtin__.dict",
- "__builtin__.long",
- "typing.Any",
- "__builtin__.list",
- "collections.defaultdict",
- "omegaconf.dictconfig.DictConfig",
- "omegaconf.nodes.AnyNode",
- "omegaconf.base.ContainerMetadata",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "omegaconf.listconfig.ListConfig",
- "torch._utils._rebuild_tensor_v2",
- "omegaconf.base.Metadata"
How to fix it?
8.19 GB Add global_step_120
