Teflon_0.2 / tokenizer_config.json
yarik921's picture
Upload tokenizer_config.json
9014569
{
"bos_token" : "<s>",
"do_lower_case" : true,
"eos_token" : "</s>",
"pad_token" : "<pad>",
"tokenizer_class" : "Wav2Vec2CTCTokenizer",
"unk_token" : "<unk>",
"word_delimiter_token" : "|"
}