CryptoTrendPredictor / tokenizer_config.json
Tasfiya025's picture
Create tokenizer_config.json
31f3d33 verified
{
"do_lower_case": true,
"tokenizer_class": "BertTokenizer",
"model_max_length": 256,
"special_tokens_map_file": null,
"tokenizer_type": "bert"
}