dummy / tokenizer_config.json
mengzhouxia's picture
added tokenizer
a5e9388
{"do_lower_case": true, "model_max_length": 512}