Hugging Face's logo

flexitok
/
parity-aware-bpe-devset

tokenizer
bpe
multilingual
parity-aware
Model card Files
xet
 Community
parity-aware-bpe-devset / tokenizer_old.json

Commit History

  1. Rename tokenizer.json to tokenizer_old.json

    gsaltintas
    Verified signature
    7ddeefa