23 pickle imports?

by isopods-and-millipedes - opened Oct 15, 2024

Oct 15, 2024

I notice 23 pickle imports in this project.
I'm not sure how to tell if they are harmful.

/training_args.bin

Detected Pickle imports (8)

"transformers.trainer_utils.IntervalStrategy",
"transformers.trainer_utils.HubStrategy",
"transformers.training_args.TrainingArguments",
"accelerate.utils.dataclasses.DistributedType",
"transformers.training_args.OptimizerNames",
"torch.device",
"accelerate.state.PartialState",
"transformers.trainer_utils.SchedulerType"

/checkpoint-801/rng_state.pth

Detected Pickle imports (7)

"numpy.dtype",
"torch.ByteStorage",
"numpy.ndarray",
"numpy.core.multiarray._reconstruct",
"torch._utils._rebuild_tensor_v2",
"collections.OrderedDict",
"_codecs.encode"

/checkpoint-801/training_args.bin

Detected Pickle imports (8)

isopods-and-millipedes changed discussion title from pickles? to 23 pickle imports? Oct 15, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment