KcRoBERTa-dev / tokenizer_config.json
beomi's picture
Add 140k Model
d86cff4
raw
history blame contribute delete
179 Bytes
{
"model_max_length": 512,
"name_or_path": "./KcRoBERTa",
"special_tokens_map_file": "./KcRoBERTa/special_tokens_map.json",
"tokenizer_class": "PreTrainedTokenizerFast"
}