Add Balochi SentencePiece BPE tokenizer
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ tags:
|
|
| 13 |
|
| 14 |
# Balochi SentencePiece BPE Tokenizer
|
| 15 |
|
| 16 |
-
SentencePiece BPE tokenizer trained on
|
| 17 |
Designed for Balochi written in Perso-Arabic script.
|
| 18 |
|
| 19 |
## Character Inventory
|
|
|
|
| 13 |
|
| 14 |
# Balochi SentencePiece BPE Tokenizer
|
| 15 |
|
| 16 |
+
SentencePiece BPE tokenizer trained on Balochi data.
|
| 17 |
Designed for Balochi written in Perso-Arabic script.
|
| 18 |
|
| 19 |
## Character Inventory
|