trixyL commited on
Commit
4355810
·
verified ·
1 Parent(s): 64d565f

add: mdm mask in special tokens

Browse files
special_tokens_simplestories_8k.json CHANGED
@@ -1,3 +1,4 @@
1
  {
2
- "<|endoftext|>": 7999
 
3
  }
 
1
  {
2
+ "<|endoftext|>": 7999,
3
+ "<|mdm_mask|>": 8000
4
  }