test / tokenizer_config.json
DeppOlsen's picture
Update tokenizer_config.json
2427f40 verified
{
"tokenizer_class": "TransfoXLTokenizer",
"vocab_size": 267735,
"lower_case": false
}