PromptAI / tokenizer_config.json
El-Alberto67's picture
Create tokenizer_config.json
68051c9 verified
{
"model_max_length": 1024,
"padding_side": "right",
"truncation_side": "right"
}