LFM2.5-Encoder-230M / special_tokens_map.json
iamleonie's picture
Initial public commit
0b649ad
Raw
History Blame Contribute Delete
120 Bytes
{
"bos_token": "<|startoftext|>",
"eos_token": "<|im_end|>",
"mask_token": "<|mask|>",
"pad_token": "<|pad|>"
}