GPT2ES_PosWeighted01_tokenizer / added_tokens.json
CatBarks's picture
Upload tokenizer
c093524 verified
raw
history blame contribute delete
57 Bytes
{
"<EOS>": 50258,
"<PAD>": 50259,
"<SOS>": 50257
}