GPT2-chitchat / tokenizer_config.json
Alethea's picture
Update tokenizer_config.json
ab5a7f1
raw
history blame contribute delete
82 Bytes
{
"sep_token": "[SEP]",
"pad_token": "[PAD]",
"cls_token": "[CLS]"
}