gsaltintas commited on
Commit
d143eea
·
verified ·
1 Parent(s): 8d2b461

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit_super_mapping.json with huggingface_hub

Browse files
mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit_super_mapping.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"0": 110927, "1": 110930, "2": 110925, "3": 110926, "4": 110929, "5": 110928, "6": 0, "7": 1, "8": 10926, "9": 22037, "10": 33148, "11": 44259, "12": 55370, "13": 66481, "14": 77592, "15": 88703, "16": 99814, "17": 10927, "18": 12038, "19": 13149, "20": 14260, "21": 15371, "22": 16482, "23": 17593, "24": 18704, "25": 19815, "26": 20926, "27": 22038, "28": 23149, "29": 24260, "30": 25371, "31": 26482, "32": 27593, "33": 28704, "34": 29815, "35": 30926, "36": 32037, "37": 33149, "38": 34260, "39": 35371, "40": 36482, "41": 37593, "42": 38704, "43": 39815, "44": 40926, "45": 42037, "46": 43148, "47": 44260, "48": 45371, "49": 46482, "50": 47593, "51": 48704, "52": 49815, "53": 50926, "54": 52037, "55": 53148, "56": 54259, "57": 55371, "58": 56482, "59": 57593, "60": 58704, "61": 59815, "62": 60926, "63": 62037, "64": 63148, "65": 64259, "66": 65370, "67": 66482, "68": 67593, "69": 68704, "70": 69815, "71": 70926, "72": 72037, "73": 73148, "74": 74259, "75": 75370, "76": 76481, "77": 77593, "78": 78704, "79": 79815, "80": 80926, "81": 82037, "82": 83148, "83": 84259, "84": 85370, "85": 86481, "86": 87592, "87": 88704, "88": 89815, "89": 90926, "90": 92037, "91": 93148, "92": 94259, "93": 95370, "94": 96481, "95": 97592, "96": 98703, "97": 99815, "98": 100926, "99": 102037, "100": 103148, "101": 104259, "102": 105370, "103": 106481, "104": 107592, "105": 108703, "106": 109814}