Lab5_thai_bert-finetune / added_tokens.json
Jetsadaporn409's picture
Upload tokenizer
ca4bc1e verified
raw
history blame contribute delete
97 Bytes
{
"<|endoftext|>": 50265,
"<|pad|>": 50268,
"<|startoftext|>": 50266,
"<|unk|>": 50267
}