Txa1-4B-Tokenizer / added_tokens.json
rxmha125's picture
Upload 5 files
d024989 verified
{
"<|eot|>": 32002,
"<|im_end|>": 32001,
"<|im_start|>": 32000
}