Hugging Face's logo

tachiwin
/
tokenizer_test2

tokenizers
tokenizer
multilingual
byte-level-bpe
indigenous-languages
tachiwin
Model card Files
xet
 Community
tokenizer_test2

Commit History

  1. Upload README.md with huggingface_hub

    ljcamargo
    Verified signature
    eb95817

  2. Upload folder using huggingface_hub

    ljcamargo
    Verified signature
    dddbc08

  3. Upload tokenizer.json with huggingface_hub

    ljcamargo
    Verified signature
    a84c1fb

  4. Upload recipe/train_config.yaml with huggingface_hub

    ljcamargo
    Verified signature
    8bb25e1

  5. Upload recipe/corpus_checksums.json with huggingface_hub

    ljcamargo
    Verified signature
    f0bdba1

  6. Upload recipe/corpus_stats.json with huggingface_hub

    ljcamargo
    Verified signature
    4ff7650

  7. Upload recipe/corpus_manifest.csv with huggingface_hub

    ljcamargo
    Verified signature
    b56c4b0

  8. Upload recipe/special_tokens.txt with huggingface_hub

    ljcamargo
    Verified signature
    7467fae

  9. initial commit

    ljcamargo
    Verified signature
    8bcdcf9