added other config files
Browse files
tokenizer/{tokenizer_merges.txt → merges.txt}
RENAMED
|
File without changes
|
tokenizer/{tokenizer_special_tokens_map.json → special_tokens_map.json}
RENAMED
|
File without changes
|
tokenizer/{tokenizer_tokenizer_config.json → tokenizer_config.json}
RENAMED
|
File without changes
|
tokenizer/{tokenizer_vocab.json → vocab.json}
RENAMED
|
File without changes
|