Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
almaghrabima
/
SARFTokenizer
like
0
Text Generation
Arabic
English
tokenizer
arabic
morphology
bpe
deeplatent
english
License:
cc-by-nc-4.0
Model card
Files
Files and versions
xet
Community
main
SARFTokenizer
/
lexicons
100 MB
1 contributor
History:
2 commits
almaghrabima
Upload lexicons/lexicon_en.txt with huggingface_hub
eef9b5a
verified
2 days ago
lexicon_ar.txt
34.6 MB
xet
Upload lexicons/lexicon_ar.txt with huggingface_hub
2 days ago
lexicon_en.txt
65.9 MB
xet
Upload lexicons/lexicon_en.txt with huggingface_hub
2 days ago
