sigil-ml
/

WikipediaBPETokenizer

Model card Files Files and versions

WikipediaBPETokenizer / tokenizer.json

sdwalker62's picture

Rename bpe_tokenizer.json to tokenizer.json

37b9e7d verified 12 months ago

history contribute delete

842 kB

File too large to display, you can check the raw version instead.