Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json d97845c verified Rakiros commited on Jan 14, 2024
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json 1611658 verified Rakiros commited on Jan 14, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json bfa80b9 verified Rakiros commited on Jan 14, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt abc986c verified Rakiros commited on Jan 14, 2024