Rogarcia18
/

wikitext2-bpe-tokenizer

Model card Files Files and versions

wikitext2-bpe-tokenizer / tokenizer.json

Commit History

Upload BPE tokenizer trained on WikiText-2

c9e63eb
verified

Rogarcia18 commited on Sep 19, 2025