sigil-ml
/

WikipediaBPETokenizer

Model card Files Files and versions

WikipediaBPETokenizer / tokenizer.json

Commit History

Rename bpe_tokenizer.json to tokenizer.json

37b9e7d
verified

sdwalker62 commited on Jan 9