add tokenizer
1403466 - 1.52 kB initial commit
- 7.63 kB update
- 140 Bytes update
- 727 Bytes Remove "pad_token_id": 128009,
- 194 Bytes add model
- 4.89 GB add model
- 4.83 GB add model
- 5 GB add model
- 5 GB add model
- 4.83 GB add model
- 5 GB add model
- 2.57 GB add model
- 24 kB add model
- 296 Bytes add tokenizer
- 9.09 MB add tokenizer
- 55.4 kB add tokenizer
training_args.bin Detected Pickle imports (12)
- "transformers.trainer_utils.IntervalStrategy",
- "torch.float16",
- "accelerate.state.PartialState",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.HubStrategy",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "llm_pft.arguments.trainer_args.TrainerArgs",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.OptimizerNames"
How to fix it?
6.39 kB add model
