SI-FT-CL-7B-Python / added_tokens.json
zichao22's picture
Upload tokenizer
feb2371 verified
{
"▁<EOT>": 32003,
"▁<MID>": 32001,
"▁<PRE>": 32000,
"▁<SUF>": 32002
}