Subnet6Training4 / added_tokens.json
deepnet's picture
Upload tokenizer
c5a9fb3 verified
{
"<|end_of_turn|>": 32000,
"<|pad_0|>": 32001
}