Hugging Face's logo

OiQ
/
daa-tokenizers

Arabic
Latin
tokenizer
moroccan-darija
arabic
bpe
unigram
wordpiece
bbpe
benchmark
Model card Files
xet
 Community
daa-tokenizers / transformers_tokenizers /shared_bpe_32000
1.46 kB
  • 1 contributor
 History: 2 commits
Ouaill's picture
Ouaill
Upload transformers_tokenizers/shared_bpe_32000/tokenizer_config.json with huggingface_hub
9148049 verified