ljt019
/

nanochat-d40

Text Generation

Model card Files Files and versions

2.15 GB

1 contributor

History: 6 commits

ljt019's picture

fix tokenization bug

83dee14 verified about 2 months ago

.gitattributes

1.52 kB

initial commit about 2 months ago
README.md

788 Bytes

fix about 2 months ago
checkpoint_meta.json

259 Bytes

Init about 2 months ago
config.json

367 Bytes

Init about 2 months ago
configuration_nanochat.py

813 Bytes

Fix about 2 months ago
generation_config.json

108 Bytes

Fix about 2 months ago
modeling_nanochat.py

6.48 kB

Fix about 2 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.15 GB
xet

Init about 2 months ago
special_tokens_map.json

299 Bytes

Init about 2 months ago
token_bytes.pt
Detected Pickle imports (3)
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
264 kB
xet

Init about 2 months ago
tokenization_nanochat.py

6.22 kB

fix tokenization bug about 2 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
846 kB
xet

Init about 2 months ago
tokenizer_config.json

290 Bytes

Fix about 2 months ago