albert-mns-tokenizer-normalized / added_tokens.json
davaa33's picture
Upload tokenizer
12ee284 verified
raw
history blame contribute delete
38 Bytes
{
"<mask>": 8001,
"<pad>": 8000
}