Hugging Face's logo

DatarrX
/
myX-Tokenizer

Feature Extraction
Burmese
English
Pāli
sentencepiece
tokenizer
unigram
myanmar
burmese
nlp
Model card Files
xet
 Community
myX-Tokenizer

Commit History

  1. Update README.md

    kalixlouiis
    Verified signature
    c4320d9

  2. Update README.md

    kalixlouiis
    Verified signature
    afcaac7

  3. Upload benchmark.png

    kalixlouiis
    Verified signature
    d2d25cd

  1. Upload 2 files

    kalixlouiis
    Verified signature
    d5d8899

  2. Delete tokenizer.vocab

    kalixlouiis
    Verified signature
    9a5f830

  3. Delete tokenizer.model

    kalixlouiis
    Verified signature
    bdc98bf

  1. Upload 2 files

    kalixlouiis
    Verified signature
    4c1efa0

  2. Delete tokenizer.vocab

    kalixlouiis
    Verified signature
    786a0dc

  3. Delete tokenizer.model

    kalixlouiis
    Verified signature
    1b2b6ba

  4. Update README.md

    kalixlouiis
    Verified signature
    ddb03f8

  5. Delete myX-Tokenizer.vocab

    kalixlouiis
    Verified signature
    776dc65

  6. Delete myX-Tokenizer.model

    kalixlouiis
    Verified signature
    29cd768

  7. Upload tokenizer.vocab with huggingface_hub

    kalixlouiis
    Verified signature
    6e4c2a6

  8. Upload tokenizer.model with huggingface_hub

    kalixlouiis
    Verified signature
    95dc819

  1. Update README.md

    kalixlouiis
    Verified signature
    444c401

  2. Upload 2 files

    kalixlouiis
    Verified signature
    703cfa0

  3. initial commit

    kalixlouiis
    Verified signature
    586a4ed