Poralus-Image-1 / tokenizer /tokenizer_config.json
Sayana
Add files using upload-large-folder tool
f33d8d8 verified
{
"bos_token": "<|endoftext|>",
"do_lower_case": true,
"eos_token": "<|endoftext|>",
"model_max_length": 77,
"pad_token": "<|endoftext|>",
"tokenizer_class": "CLIPTokenizer"
}