KoreanLM-1.5b / added_tokens.json
quantumaikr's picture
Upload tokenizer
08fecf6
raw
history blame contribute delete
29 Bytes
{
"<|endoftext|>": 32000
}