Update README.md

README.md

@@ -21,22 +21,22 @@ This tokenizer supports the following special tokens:
 - `|||IP_ADDRESS|||`: Not used. Kept for compatibility with Dolma 1.x.
 - `<|im_start|>`: Indicates the beginning of a message (turn in a conversation).
 - `<|im_end|>`: Indicates the end of a message (turn in a conversation).
+- `<functions>`: Indicates start of function definitions in the system prompt for tool use.
+- `</functions>`: Indicates end of function definitions in the sytem prompt.
+- `<function_calls>`: Indicates start of function calls made by the model.
+- `</function_calls>`: Indicates end of function calls made by the model.
 - `<|extra_id_1|>`: Not used.
 - `<|extra_id_2|>`: Not used.
-- `<think>`: Indicates the beginning of model thoughts.
-- `</think>`: Indicates the end of model thoughts.
 - `<|extra_id_3|>`: Not used.
 - `<|extra_id_4|>`: Not used.
 - `<|extra_id_5|>`: Not used.
 - `<|extra_id_6|>`: Not used.
-- `<answer>`: Indicates the beginning of model answer in thinking mode.
-- `</answer>`: Indicates the end of model answer in thinking mode.
+- `<|extra_id_7|>`: Not used.
+- `<|extra_id_8|>`: Not used.
+- `<|extra_id_9|>`: Not used.
+- `<|extra_id_10|>`: Not used.
 - `<|endofprompt|>`: Not Used.
 - `<|pad|>`: Symbol to pad input sequences.
-- `<functions>`: Indicates start of function definitions in the system prompt for tool use.
-- `</functions>`: Indicates end of function definitions in the sytem prompt.
-- `<function_calls>`: Indicates start of function calls made by the model.
-- `</function_calls>`: Indicates end of function calls made by the model.
 
 
 ## Chat template