Upload tokenizer
bf56819 verified - 1.52 kB initial commit
- 5.17 kB Upload tokenizer
- 1.08 kB Upload tokenizer
- 735 Bytes Uploaded checkpoint-5000
- 69 Bytes Uploaded checkpoint-5000
- 456 kB Upload tokenizer
- 2.84 GB Uploaded checkpoint-30000
optimizer.pt Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
5.67 GB Uploaded checkpoint-30000 rng_state.pth Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "numpy.core.multiarray._reconstruct",
- "torch.ByteStorage",
- "numpy.dtype",
- "collections.OrderedDict",
- "numpy.ndarray",
- "_codecs.encode"
How to fix it?
14.2 kB Uploaded checkpoint-30000 - 1.06 kB Uploaded checkpoint-30000
- 441 Bytes Upload tokenizer
- 2.11 MB Upload tokenizer
- 7.34 kB Upload tokenizer
- 470 kB Uploaded checkpoint-30000
training_args.bin Detected Pickle imports (9)
- "transformers.trainer_utils.SchedulerType",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.HubStrategy",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.state.PartialState"
How to fix it?
4.86 kB Uploaded checkpoint-5000 - 798 kB Upload tokenizer
