Doron Adler commited on
Commit ·
209851b
1
Parent(s): 8af0c8b
added_tokens.json
Browse files- added_tokens.json +1 -1
added_tokens.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"<|
|
|
|
|
| 1 |
+
{"<|unknown|>": 50259, "<|startoftext|>": 50258, "<|endoftext|>": 50257}
|