binaryalign-zhen / added_tokens.json
DeepTranslateAdmin's picture
Upload tokenizer
cf8e91c verified
raw
history blame contribute delete
49 Bytes
{
" [WORD_SEP] ": 250102,
"[MASK]": 250101
}