kogpt2-chatbot-lora / added_tokens.json
khamrai's picture
Upload tokenizer
7a3b50d verified
{
"<|endoftext|>": 51200
}