Tekitou-Merge / tokenizer

Commit History

Rename vocab.json to tokenizer/vocab.json
72cb363

megasuta80 commited on

Rename special_tokens_map.json to tokenizer/special_tokens_map.json
9124d36

megasuta80 commited on

Rename tokenizer/model_index.json to model_index.json
3acd589

megasuta80 commited on

Rename tokenizer_config.json to tokenizer/tokenizer_config.json
d606224

megasuta80 commited on

Rename model_index.json to tokenizer/model_index.json
d12f59d

megasuta80 commited on

Rename merges.txt to tokenizer/merges.txt
15ae005

megasuta80 commited on