IntervitensInc
/

gemma-2-9b-chatml

Text Generation

text-generation-inference

Model card Files Files and versions

intervitens commited on Sep 30, 2024

Commit

76e349d

·

verified ·

1 Parent(s): d29a005

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -2

tokenizer_config.json CHANGED Viewed

@@ -64,7 +64,7 @@
       "normalized": false,
       "rstrip": false,
       "single_word": false,
-      "special": false
     },
     "8": {
       "content": "<|im_end|>",
@@ -72,7 +72,7 @@
       "normalized": false,
       "rstrip": false,
       "single_word": false,
-      "special": false
     },
     "9": {
       "content": "<unused2>",

       "normalized": false,
       "rstrip": false,
       "single_word": false,
+      "special": true
     },
     "8": {
       "content": "<|im_end|>",
       "normalized": false,
       "rstrip": false,
       "single_word": false,
+      "special": true
     },
     "9": {
       "content": "<unused2>",