needle_finetune_example / tokenizer-specials.json
justinebert1's picture
Upload tokenizer-specials.json with huggingface_hub
7b4e519 verified
raw
history blame contribute delete
70 Bytes
{
"pad": 0,
"eos": 1,
"bos": 2,
"tool_call": 4,
"tools": 5
}