Hugging Face's logo

niklassheth
/
tinystories-tokenizer

Transformers
Model card Files
xet
Community
tinystories-tokenizer / tokenizer.json

Commit History

Upload custom TinyStories BPE tokenizer (vocab_size=8192)
9d85d76
verified

niklassheth commited on