Commit
·
ac09091
1
Parent(s):
e6b2fed
Delete added_tokens.json
Browse files- added_tokens.json +0 -12
added_tokens.json
DELETED
|
@@ -1,12 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"<|endoftext|>": 50000,
|
| 3 |
-
"[SEP]": 50001,
|
| 4 |
-
"[CLS]": 50002,
|
| 5 |
-
"[MASK]": 50003,
|
| 6 |
-
"[UNUSED1]": 50004,
|
| 7 |
-
"[UNUSED2]": 50005,
|
| 8 |
-
"<|startofpiece|>": 50006,
|
| 9 |
-
"<|endofpiece|>": 50007,
|
| 10 |
-
"[sMASK]": 50008,
|
| 11 |
-
"[gMASK]": 50009
|
| 12 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|