Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json bbbe1c0 verified WhiskeyRacoon commited on Feb 3, 2024
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json 613feab verified WhiskeyRacoon commited on Feb 3, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 54cc7c3 verified WhiskeyRacoon commited on Feb 3, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt b88201f verified WhiskeyRacoon commited on Feb 3, 2024