IndicBERT-MLM-Wiki / tokenizer_config.json
sumanthd's picture
add tokenizer
1a6339e
{
"tokenizer_class": "PreTrainedTokenizerFast"
}