stldec_random_16 / special_tokens_map.json
saracandu's picture
Upload tokenizer
2f28bad verified
raw
history blame contribute delete
88 Bytes
{
"bos_token": "/s",
"eos_token": "s",
"pad_token": "pad",
"unk_token": "unk"
}