base2 / tokenizer_config.json
gszabo's picture
Upload tokenizer
4a830b4
raw
history blame
51 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast"
}