molm_log_prob / special_tokens_map.json
robinfaro's picture
Adding files from hf_modeling_btm_log_prob_mixing
e21712a verified
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}