test / tokenizer_config.json
gszabo's picture
Upload tokenizer
b30e666
raw
history blame
51 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast"
}