GPT2-tokenizer / added_tokens.json
georgeyw's picture
Upload 6 files
42ca805
{
"<|endoftext|>": 50256
}