5.57 GB

Ctrl+K

1 contributor

History: 10 commits

abideen

Upload tokenizer

970b275 verified about 2 years ago

assets
Upload folder using huggingface_hub about 2 years ago
outputs
Upload folder using huggingface_hub about 2 years ago
src
Upload folder using huggingface_hub about 2 years ago
.gitattributes

1.52 kB
initial commit about 2 years ago
.gitignore

67 Bytes
Upload folder using huggingface_hub about 2 years ago
README.md

3.08 kB
Upload tokenizer about 2 years ago
added_tokens.json

1.08 kB
Upload tokenizer about 2 years ago
config.json

898 Bytes
Upload folder using huggingface_hub about 2 years ago
generation_config.json

119 Bytes
Upload folder using huggingface_hub about 2 years ago
main.py

10.4 kB
Upload folder using huggingface_hub about 2 years ago
merges.txt

456 kB
Upload tokenizer about 2 years ago
model-00001-of-00002.safetensors

5 GB
xet

Upload folder using huggingface_hub about 2 years ago
model-00002-of-00002.safetensors

564 MB
xet

Upload folder using huggingface_hub about 2 years ago
model.safetensors.index.json

40.2 kB
Upload folder using huggingface_hub about 2 years ago
special_tokens_map.json

441 Bytes
Upload tokenizer about 2 years ago
tokenizer.json

2.11 MB
Upload tokenizer about 2 years ago
tokenizer_config.json

7.34 kB
Upload tokenizer about 2 years ago
training_args.bin
Detected Pickle imports (9)
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.state.PartialState",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy"
How to fix it?
4.98 kB
xet

Upload folder using huggingface_hub about 2 years ago
vocab.json

798 kB
Upload tokenizer about 2 years ago

Detected Pickle imports (9)