Hugging Face's logo

ihanif
/
pashto-tokenizer

Pashto
pashto
tokenizer
bpe
sentencepiece
low-resource
nlp
Model card Files
xet
 Community
pashto-tokenizer

Commit History

Upload sentencepiece/pashto_bpe_32k.vocab with huggingface_hub
886543b
verified

ihanif commited on

Upload sentencepiece/pashto_bpe_32k.model with huggingface_hub
6eceb9d
verified

ihanif commited on

Upload special_tokens_map.json with huggingface_hub
ced190f
verified

ihanif commited on

Upload tokenizer_config.json with huggingface_hub
f7eaaf8
verified

ihanif commited on

Upload tokenizer.json with huggingface_hub
1d5f670
verified

ihanif commited on

Upload tokenizer_report.json with huggingface_hub
4a1357b
verified

ihanif commited on

Upload README.md with huggingface_hub
46a2228
verified

ihanif commited on

initial commit
9c62b47
verified

ihanif commited on