Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
almaghrabima
/
SARFTokenizer
like
1
Text Generation
Arabic
English
tokenizer
arabic
morphology
bpe
deeplatent
english
License:
cc-by-nc-4.0
Model card
Files
Files and versions
xet
Community
main
SARFTokenizer
/
.gitattributes
Commit History
Upload lexicons/lexicon_en.txt with huggingface_hub
eef9b5a
verified
almaghrabima
commited on
Feb 8
Upload lexicons/lexicon_ar.txt with huggingface_hub
453d9e0
verified
almaghrabima
commited on
Feb 8
initial commit
213dca4
verified
almaghrabima
commited on
Feb 4