trixyL commited on
Commit
5a776e2
·
verified ·
1 Parent(s): b52ca83

add: mdm mask spec token

Browse files
special_tokens_simplestories_8k.json CHANGED
@@ -1,3 +1,4 @@
1
  {
2
- "<|endoftext|>": 7999
 
3
  }
 
1
  {
2
+ "<|endoftext|>": 7999,
3
+ "<|mdm_mask|>": 8000
4
  }