trixyL commited on
Commit
c6032b5
·
verified ·
1 Parent(s): 129e9a9

remove: pad token

Browse files
Files changed (1) hide show
  1. special_tokens.json +2 -3
special_tokens.json CHANGED
@@ -1,5 +1,4 @@
1
  {
2
- "<|pad|>": 50256,
3
- "<|endoftext|>": 50257,
4
- "<|mdm_mask|>": 50258
5
  }
 
1
  {
2
+ "<|endoftext|>": 50256,
3
+ "<|mdm_mask|>": 50257
 
4
  }