Update README.md
Browse files
README.md
CHANGED
|
@@ -2,6 +2,6 @@
|
|
| 2 |
library_name: transformers
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
-
This is a tokenizer with same settings as [https://huggingface.co/google-bert/bert-base-uncased
|
| 6 |
|
| 7 |
Has a vocab size of 30K and was trained on various corpus including Nepali wikipedia, new articles etc.
|
|
|
|
| 2 |
library_name: transformers
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
+
This is a tokenizer with same settings as [bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) but sets `strip_accents=False`.
|
| 6 |
|
| 7 |
Has a vocab size of 30K and was trained on various corpus including Nepali wikipedia, new articles etc.
|