database-config-tokenizer / added_tokens.json
MuskanBansal's picture
Upload tokenizer
55d6969
raw
history blame contribute delete
71 Bytes
{
"</s>": 2,
"<mask>": 4,
"<pad>": 1,
"<s>": 0,
"<unk>": 3
}