saracandu commited on
Commit
f99d658
·
verified ·
1 Parent(s): ff19afe

added vocabulary file, tokenizer.json

Browse files
Files changed (1) hide show
  1. tokenizer.json +1 -0
tokenizer.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"unk": 0, "pad": 1, "/s": 2, "s": 3, "(": 4, ")": 5, "always": 6, "eventually": 7, "until": 8, "and": 9, "or": 10, "not": 11, ">=": 12, "<=": 13, ">": 14, "<": 15, "=": 16, "x_": 17, "[": 18, "]": 19, ",": 20, "inf": 21, "-": 22, ".": 23, "0": 24, "1": 25, "2": 26, "3": 27, "4": 28, "5": 29, "6": 30, "7": 31, "8": 32, "9": 33, "@": 34}