kaienai
/

tinystories-tokenizer

Model card Files Files and versions

tinystories-tokenizer / tokenizer.json

Commit History

Add TinyStories BPE tokenizer (8k vocab)

752493a
verified

DmitriyYurckML commited on about 15 hours ago