Hugging Face's logo

almaghrabima
/
deeplatent-tokenizer-parity

tokenizer
bpe
myte
sarf
parity-aware
deeplatent
bilingual
arabic-english
morfessor
Model card Files
xet
Community
deeplatent-tokenizer-parity / training
23.5 GB
  • 1 contributor
 History: 5 commits
almaghrabima's picture
almaghrabima
Upload parity-aware MYTE tokenizer artifacts
a879a93 verified