tinystories-tokenizer / special_tokens_map.json

Commit History

Upload custom TinyStories BPE tokenizer (vocab_size=8192)
9d85d76
verified

niklassheth commited on