Hugging Face's logo

almaghrabima
/
SARFTokenizer

Arabic
English
tokenizers
tokenizer
sarf
bilingual
arabic
english
math
code
sentencepiece-style
Model card Files
xet
 Community
SARFTokenizer / bench_results.json

Commit History

Promote v0.3.1 to main (4-domain SOTA at 100k vocab)
f6c72b6
verified

almaghrabima commited on