Upload folder using huggingface_hub

README.md

@@ -31,7 +31,7 @@ A **Byte-Level BPE** tokenizer trained on **cmn_Hani** data from Fineweb-2-HQ.
 ```python
 from transformers import AutoTokenizer
 
-tokenizer = AutoTokenizer.from_pretrained("<repo_id>")
+tokenizer = AutoTokenizer.from_pretrained("flexitok/-bpe_cmn_Hani_16000")
 tokens = tokenizer.encode("Hello, world!")
 ```