Rogarcia18
/

wikitext2-bpe-tokenizer

Model card Files Files and versions

wikitext2-bpe-tokenizer / tokenizer.json

Rogarcia18's picture

Upload BPE tokenizer trained on WikiText-2

c9e63eb verified 5 months ago

history contribute delete

2.14 MB

File too large to display, you can check the raw version instead.