Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json b5470eb verified lee45 commited on Jun 17, 2024
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json ebb5827 verified lee45 commited on Jun 17, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 62300d9 verified lee45 commited on Jun 17, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt bbf788a verified lee45 commited on Jun 17, 2024