ardauzunoglu
/

kth_tokenizer

Model card Files Files and versions

ardauzunoglu commited on Feb 16

Commit

8054815

·

verified ·

1 Parent(s): 90aed0b

Upload tokenizer

Files changed (1) hide show

tokenizer.json +3 -3

tokenizer.json CHANGED Viewed

@@ -72,9 +72,9 @@
       "K5": 20,
       "K6": 21,
       "K7": 22,
-      "K8": 23,
-      "EQUALS": 24,
-      "END": 25,
       "K9": 26,
       "K10": 27,
       "SELECT": 28,

       "K5": 20,
       "K6": 21,
       "K7": 22,
+      "EQUALS": 23,
+      "END": 24,
+      "K8": 25,
       "K9": 26,
       "K10": 27,
       "SELECT": 28,