SaeedRahmani
/

fa-tokenizer

Model card Files Files and versions

fa-tokenizer / wiki

3.91 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

SaeedRahmani's picture

Upload /wiki/tokenizer_wiki_10k.json with huggingface_hub

1decb50 verified over 2 years ago

tokenizer_wiki_100k.json

1.8 MB
Upload /wiki/tokenizer_wiki_100k.json with huggingface_hub over 2 years ago
tokenizer_wiki_10k.json

314 kB
Upload /wiki/tokenizer_wiki_10k.json with huggingface_hub over 2 years ago
tokenizer_wiki_1m.json

1.79 MB
Upload /wiki/tokenizer_wiki_1m.json with huggingface_hub over 2 years ago