roberta_tokenizer_fast / added_tokens.json
windowsartes's picture
Upload tokenizer
372d5ef verified
raw
history blame contribute delete
113 Bytes
{
"</s>": 912,
"<s>": 911,
"[CLS]": 909,
"[MASK]": 910,
"[PAD]": 908,
"[SEP]": 907,
"[UNK]": 906
}