testmodel2 / tokenizer

Commit History

Upload 17 files
0bce388
verified

Rakiros commited on

Delete tokenizer
e0f2683
verified

Rakiros commited on

Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json
d97845c
verified

Rakiros commited on

Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json
1611658
verified

Rakiros commited on

Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json
bfa80b9
verified

Rakiros commited on

Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt
abc986c
verified

Rakiros commited on

Upload 17 files
f7ea748
verified

Rakiros commited on