Felix Marty commited on
Commit
abf2557
·
1 Parent(s): 22bbaea

move tokenizer

Browse files
my_folder/sentencepiece.bpe.model → sentencepiece.bpe.model RENAMED
File without changes
my_folder/special_tokens_map.json → special_tokens_map.json RENAMED
File without changes
my_folder/tokenizer_config.json → tokenizer_config.json RENAMED
File without changes