FlareNew / tokenizer_config.json
HaveAI's picture
Update tokenizer_config.json
a31170b verified
raw
history blame
159 Bytes
{
"model_max_length": 64,
"tokenizer_class": "T5Tokenizer",
"name_or_path": "./MyT5Tokenizer",
"special_tokens_map_file": "special_tokens_map.json"
}