Upload folder using huggingface_hub

README.md

@@ -46,4 +46,4 @@ tokens = tokenizer.encode("Hello, world!")
 ## Sample Encoding
 | Text | Tokens | Token IDs |
 |------|--------|-----------|
-| `1234500119 mod 67` | `12345, 0, 0, 119,  , mod,  , 67` | `34991, 67052, 67052, 60107, 6, 4, 6, 26613` |
+| `1234500119 mod 67` | `12345, 0, 0, 119,  , mod,  , 67` | `2345, 12100, 12100, 18884, 6, 4, 6, 73563` |

tokenizer.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:380038bc9be2f9ac4bb986587ff2973e02c056bffaf3bbe565f811aa89feb43d
-size 18078789
+oid sha256:23df52bf16bfcd16ad7ac40bea24bd5a437d7a6ac7f8017c8541cbfab8f9b002
+size 18078790

tokenizer_config.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3dfc2476e35bf47065786e24005202eb03763434edc20bed574d2cc0002766c8
-size 17078169
+oid sha256:2fc38c6adbab51602c86d18b9395edbc4b80a67f1de5fd91e749db70a80ad1e6
+size 17078170