IntervitensInc
/

Mistral-Small-24B-Instruct-2501-chatml

Text Generation

text-generation-inference

Model card Files Files and versions

intervitens commited on Feb 2, 2025

Commit

779700d

·

verified ·

1 Parent(s): c9dbf5e

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -2

tokenizer_config.json CHANGED Viewed

@@ -8025,8 +8025,8 @@
     "[SYSTEM_PROMPT]",
     "[/SYSTEM_PROMPT]",
     "[TOOL_CONTENT]",
-    "<SPECIAL_20>",
-    "<SPECIAL_21>",
     "<SPECIAL_22>",
     "<SPECIAL_23>",
     "<SPECIAL_24>",

     "[SYSTEM_PROMPT]",
     "[/SYSTEM_PROMPT]",
     "[TOOL_CONTENT]",
+    "<|im_start|>",
+    "<|im_end|>",
     "<SPECIAL_22>",
     "<SPECIAL_23>",
     "<SPECIAL_24>",