idk / tokenizer_config.json
SumedhJoshi's picture
Upload 3 files
0ee4e3c verified
{"do_lower_case": true, "model_max_length": 512}