NeTS-lab commited on
Commit
5d98c36
·
verified ·
1 Parent(s): e26cd9a

Upload added_tokens.json

Browse files
Files changed (1) hide show
  1. added_tokens.json +9 -0
added_tokens.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "<unk>": 0,
3
+ "<pad>": 1,
4
+ "<s>": 2,
5
+ "</s>": 3,
6
+ "<mask>": 4,
7
+ "<sep>": 5,
8
+ "<cls>": 6
9
+ }