tiny-pellm / vocab.json
herutriana44's picture
Upload tokenizer
8f14c5c verified
raw
history blame
98 Bytes
{
"<pad>": 4,
"<sep>": 3,
"<unk>": 2,
"<s>": 0,
"</s>": 1,
"<cls>": 5,
"<mask>": 6
}