obamaobama / tokenizer /added_tokens.json
mikusama's picture
End of training
5bdbe1b
raw
history blame contribute delete
57 Bytes
{
"<|endoftext|>": 49407,
"<|startoftext|>": 49406
}