code1phoenix
/

NanoChat

Model card Files Files and versions

NanoChat / tokenizer

Ctrl+K

Ctrl+K

2 contributors

History: 1 commit

code1phoenix's picture

Upload folder using huggingface_hub

01a25a9 verified 7 months ago

token_bytes.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.IntStorage"
What is a pickle import?
264 kB
xet

Upload folder using huggingface_hub 7 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
846 kB
xet

Upload folder using huggingface_hub 7 months ago