mhla
/

gpt1900-d34-8b-subset

Model card Files Files and versions

gpt1900-d34-8b-subset / tokenizer

534 kB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

mhla's picture

Upload tokenizer/token_bytes.pt with huggingface_hub

7fc9777 verified 5 months ago

token_bytes.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.IntStorage"
What is a pickle import?
133 kB
xet

Upload tokenizer/token_bytes.pt with huggingface_hub 5 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
401 kB
xet

Upload tokenizer/tokenizer.pkl with huggingface_hub 5 months ago