SaeedRahmani
/

fa-tokenizer

Model card Files Files and versions

fa-tokenizer / wiki

3.91 MB

1 contributor

History: 3 commits

SaeedRahmani's picture

Upload /wiki/tokenizer_wiki_10k.json with huggingface_hub

1decb50 verified almost 2 years ago

tokenizer_wiki_100k.json

1.8 MB

Upload /wiki/tokenizer_wiki_100k.json with huggingface_hub almost 2 years ago
tokenizer_wiki_10k.json

314 kB

Upload /wiki/tokenizer_wiki_10k.json with huggingface_hub almost 2 years ago
tokenizer_wiki_1m.json

1.79 MB

Upload /wiki/tokenizer_wiki_1m.json with huggingface_hub almost 2 years ago