kogpt2-chatbot-lora / added_tokens.json
Cyplus72's picture
Upload tokenizer
3435d7f verified
{
"<|endoftext|>": 51200
}