analysis / size-40k

49.8 GB

Ctrl+K

1 contributor

History: 9 commits

RuoliuYang

trim size-40k/checkpoint-500: drop optimizer/resume state, keep model weights

e68c321 verified 26 minutes ago

checkpoint-250
trim size-40k/checkpoint-250: drop optimizer/resume state, keep model weights 26 minutes ago
checkpoint-500
trim size-40k/checkpoint-500: drop optimizer/resume state, keep model weights 26 minutes ago
added_tokens.json

752 Bytes
Upload folder using huggingface_hub 2 days ago
chat_template.jinja

1.02 kB
Upload folder using huggingface_hub 2 days ago
config.json

3.42 kB
Upload folder using huggingface_hub 2 days ago
generation_config.json

214 Bytes
Upload folder using huggingface_hub 2 days ago
merges.txt

1.67 MB
Upload folder using huggingface_hub 2 days ago
model-00001-of-00004.safetensors

4.97 GB
xet

Upload folder using huggingface_hub 2 days ago
model-00002-of-00004.safetensors

4.99 GB
xet

Upload folder using huggingface_hub 2 days ago
model-00003-of-00004.safetensors

4.93 GB
xet

Upload folder using huggingface_hub 2 days ago
model-00004-of-00004.safetensors

1.69 GB
xet

Upload folder using huggingface_hub 2 days ago
model.safetensors.index.json

57.7 kB
Upload folder using huggingface_hub 2 days ago
preprocessor_config.json

791 Bytes
Upload folder using huggingface_hub 2 days ago
special_tokens_map.json

613 Bytes
Upload folder using huggingface_hub 2 days ago
tokenizer.json

11.4 MB
xet

Upload folder using huggingface_hub 2 days ago
tokenizer_config.json

5.66 kB
Upload folder using huggingface_hub 2 days ago
training_args.bin
Detected Pickle imports (17)
- "torch.device",
- "accelerate.state.PartialState",
- "torch._utils._rebuild_tensor_v2",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.SchedulerType",
- "torch.bfloat16",
- "collections.OrderedDict",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "trl.trainer.sft_config.SFTConfig",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "torch.LongStorage",
- "transformers.trainer_utils.SaveStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.HubStrategy"
How to fix it?
11 kB
xet

Upload folder using huggingface_hub 2 days ago
video_preprocessor_config.json

907 Bytes
Upload folder using huggingface_hub 2 days ago
vocab.json

2.78 MB
Upload folder using huggingface_hub 2 days ago

Detected Pickle imports (17)