tinystories-tokenizer / tokenizer.json
DmitriyYurckML's picture
Add TinyStories BPE tokenizer (8k vocab)
752493a verified
Raw
History Contribute Delete
554 kB
File too large to display, you can check the raw version instead.