gpt / added_tokens.json
erfyhersr's picture
Upload tokenizer
36050ca verified
raw
history blame contribute delete
225 Bytes
{
"<|begin_of_text|>": 50257,
"<|eot_id|>": 50261,
"<|start_header_id|>assistant<|end_header_id|>": 50260,
"<|start_header_id|>reasoning<|end_header_id|>": 50259,
"<|start_header_id|>user<|end_header_id|>": 50258
}