Update README.md
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@ model-index:
|
|
| 27 |
|
| 28 |
# Geez Tokenizer (`Hailay/geez-tokenizer`)
|
| 29 |
|
| 30 |
-
A **BPE tokenizer** specifically trained for **Geez-script languages**, including **Tigrinya** and **Amharic**. The tokenizer is trained on monolingual corpora
|
| 31 |
|
| 32 |
## 🧠 Motivation
|
| 33 |
|
|
|
|
| 27 |
|
| 28 |
# Geez Tokenizer (`Hailay/geez-tokenizer`)
|
| 29 |
|
| 30 |
+
A **BPE tokenizer** specifically trained for **Geez-script languages**, including **Tigrinya** and **Amharic**. The tokenizer is trained on monolingual corpora and supports morphologically rich low-resource languages.
|
| 31 |
|
| 32 |
## 🧠 Motivation
|
| 33 |
|