testmodel2 / tokenizer

Commit History

  1. Upload 17 files

    Verified signature
    0bce388
  2. Delete tokenizer

    Verified signature
    e0f2683

  1. Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json

    Verified signature
    d97845c
  2. Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json

    Verified signature
    1611658
  3. Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json

    Verified signature
    bfa80b9
  4. Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt

    Verified signature
    abc986c

  1. Upload 17 files

    Verified signature
    f7ea748