safeLM_Pretrain_LF_step35000 / added_tokens.json
Yiderigun's picture
Upload tokenizer
183fbe7 verified
{
"</dialogue>": 49153,
"<dialogue>": 49152,
"<model>": 49155,
"<teacher>": 49154
}