eligapris commited on
Commit
02c8e51
·
verified ·
1 Parent(s): b01aef0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -69,11 +69,11 @@ You can load the tokenizer in two ways:
69
  ```python
70
  # Method 1: Using AutoTokenizer (recommended)
71
  from transformers import AutoTokenizer
72
- tokenizer = AutoTokenizer.from_pretrained("your-username/kirundi-tokenizer")
73
 
74
  # Method 2: Using PreTrainedTokenizerFast with local file
75
  from transformers import PreTrainedTokenizerFast
76
- tokenizer = PreTrainedTokenizerFast(tokenizer_file="kirundi_tokenizer.json")
77
  ```
78
 
79
  #### Basic Usage Examples
 
69
  ```python
70
  # Method 1: Using AutoTokenizer (recommended)
71
  from transformers import AutoTokenizer
72
+ tokenizer = AutoTokenizer.from_pretrained("eligapris/rn-tokenizer")
73
 
74
  # Method 2: Using PreTrainedTokenizerFast with local file
75
  from transformers import PreTrainedTokenizerFast
76
+ tokenizer = PreTrainedTokenizerFast(tokenizer_file="tokenizer.json")
77
  ```
78
 
79
  #### Basic Usage Examples