add tokenizer
90fe65c verified - 1.52 kB initial commit
- 1.23 kB Upload 7 files
- 1.42 GB Upload 7 files
- 2.84 GB Upload 7 files
- 75 Bytes Update readme.md
rng_state.pth Detected Pickle imports (7)
- "collections.OrderedDict",
- "numpy.dtype",
- "numpy.ndarray",
- "numpy.core.multiarray._reconstruct",
- "_codecs.encode",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage"
How to fix it?
14.6 kB Upload 7 files - 1.47 kB Upload 7 files
- 1.36 MB add tokenizer
- 25 Bytes add tokenizer
- 4.54 kB Upload 7 files
training_args.bin Detected Pickle imports (9)
- "torch.device",
- "accelerate.state.PartialState",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.training_args.TrainingArguments"
How to fix it?
5.39 kB Upload 7 files - 899 kB add tokenizer