firstgradeai
/

unigram-tokenizer-wikitext

Model card Files Files and versions

unigram-tokenizer-wikitext / tokenizer_config.json

Commit History

Upload tokenizer

e46b2ee
verified

firstgradeai commited on Feb 16, 2024