Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json 7d1a833 verified osamaifti commited on Dec 4, 2024
Rename tokenizer/tokenizer_config.json to tokenizer/config.json 5fd2415 verified osamaifti commited on Dec 4, 2024
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json e66996d verified osamaifti commited on Dec 4, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 98228b1 verified osamaifti commited on Dec 4, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt 389058f verified osamaifti commited on Dec 4, 2024