test / tokenizer_config.json
gszabo's picture
Upload tokenizer
b30e666
{
"tokenizer_class": "PreTrainedTokenizerFast"
}