feat: add tokenizer
f77d768 verified - 676 Bytes feat: add tokenizer
- 436 MB feat: add tokenizer
- 871 MB feat: add tokenizer
rng_state.pth Detected Pickle imports (7)
- "numpy._core.multiarray._reconstruct",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "_codecs.encode",
- "numpy.ndarray",
- "numpy.dtype"
How to fix it?
14.2 kB feat: add tokenizer - 988 Bytes feat: add tokenizer
- 1.06 kB feat: add tokenizer
- 695 Bytes feat: add tokenizer
- 712 kB feat: add tokenizer
- 1.22 kB feat: add tokenizer
- 29.4 kB feat: add tokenizer
training_args.bin Detected Pickle imports (10)
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.SchedulerType",
- "accelerate.state.PartialState",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.SaveStrategy",
- "torch.device"
How to fix it?
5.3 kB feat: add tokenizer - 232 kB feat: add tokenizer
