wizaFinetuningg / added_tokens.json
abdelkader12's picture
Upload tokenizer
c70b2c5 verified
raw
history blame contribute delete
53 Bytes
{
"<|end_of_turn|>": 32000,
"<|pad_0|>": 32001
}