xlmr-base-squad / tokenizer_config.json
oceanpty's picture
Upload 8 files
5e3bafd
{"do_lower_case": false, "max_len": 512}