gpt2_instruct / added_tokens.json
Autsadin's picture
Upload tokenizer
3211e99 verified
{
"</s>": 50258,
"<CLS>": 50261,
"<EOD>": 50263,
"<MASK>": 50264,
"<PAD>": 50260,
"<SEP>": 50262,
"<s>": 50257,
"<unk>": 50259
}