Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json cf5e808 verified ZicoZ7 commited on Jan 20, 2025
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json f29bde1 verified ZicoZ7 commited on Jan 20, 2025
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json fa2c1c0 verified ZicoZ7 commited on Jan 20, 2025
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt 35a208b verified ZicoZ7 commited on Jan 20, 2025