Upload folder using huggingface_hub

README.md

@@ -46,4 +46,4 @@ tokens = tokenizer.encode("Hello, world!")
 ## Sample Encoding
 | Text | Tokens | Token IDs |
 |------|--------|-----------|
-| `1234500119 mod 67` | `12345, 0, 0, 119,  , mod,  , 67` | `2345, 12100, 12100, 18884, 6, 4, 6, 73563` |
+| `123500119 mod 67` | `12350, 01, 19,  , mod,  , 67` | `2420, 108, 25, 6, 4, 6, 53` |

tokenizer.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:23df52bf16bfcd16ad7ac40bea24bd5a437d7a6ac7f8017c8541cbfab8f9b002
-size 18078790
+oid sha256:7a4e0410a593b039852afd195a6c0d7194209be76a71866e861ee92f1d602b38
+size 6668447

tokenizer_config.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2fc38c6adbab51602c86d18b9395edbc4b80a67f1de5fd91e749db70a80ad1e6
-size 17078170
+oid sha256:8089e20ec3706db52dbe7d72665aeca7743bf465ef5cdd6710fb7475d88ac1e4
+size 1558