IndicBERT-MLM-SAM-ForMaskedLM / tokenizer_config.json
sumanthd's picture
add tokenizer
8a918ce
{
"tokenizer_class": "PreTrainedTokenizerFast"
}