pankajmathur
/

nanochat-d20

Text Generation

Model card Files Files and versions

nanochat-d20 / tokenizer

1.11 MB

1 contributor

History: 1 commit

pankajmathur's picture

Upload folder using huggingface_hub

4dec898 verified 3 months ago

token_bytes.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.IntStorage"
What is a pickle import?
264 kB
xet

Upload folder using huggingface_hub 3 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
847 kB
xet

Upload folder using huggingface_hub 3 months ago