Hugging Face's logo

almaghrabima
/
deeplatent-tokenizer-parity

tokenizer
bpe
myte
sarf
parity-aware
deeplatent
bilingual
arabic-english
morfessor
Model card Files
xet
Community
deeplatent-tokenizer-parity
23.6 GB
  • 1 contributor
 History: 7 commits
almaghrabima's picture
almaghrabima
Upload parity-aware MYTE tokenizer artifacts
a879a93 verified