almaghrabima
/

SARFTokenizer

sentencepiece-style

Model card Files Files and versions

SARFTokenizer / .gitattributes

Commit History

Add characters per 1M tokens chart

30538d8
verified

almaghrabima commited on May 11

Add API cost comparison per 1M tokens chart

89ba6f6
verified

almaghrabima commited on May 11

Upload lexicons/lexicon_en.txt with huggingface_hub

eef9b5a
verified

almaghrabima commited on Feb 8

Upload lexicons/lexicon_ar.txt with huggingface_hub

453d9e0
verified

almaghrabima commited on Feb 8

initial commit

213dca4
verified

almaghrabima commited on Feb 4