Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
almaghrabima
/
SARFTokenizer
like
1
Arabic
English
tokenizers
tokenizer
unigram
sarf
bilingual
arabic
english
sentencepiece-style
arxiv:
2512.18399
arxiv:
2508.08424
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
213dca4
SARFTokenizer
1.52 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
almaghrabima
initial commit
213dca4
verified
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago