GPT2_pw5_ES_tokenizerf / added_tokens.json
CatBarks's picture
Upload tokenizer
98f94ea verified
raw
history blame contribute delete
57 Bytes
{
"<EOS>": 50258,
"<PAD>": 50259,
"<SOS>": 50257
}