Instructions to use universalml/Nepali_Tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use universalml/Nepali_Tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("universalml/Nepali_Tokenizer", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,9 +8,6 @@ base_model:
|
|
| 8 |
- microsoft/Phi-3.5-mini-instruct
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# Model Card for Model ID
|
| 12 |
-
Nepali_tokenizer
|
| 13 |
-
|
| 14 |
## Model Details
|
| 15 |
A tokenizer designed for the Nepali language, supporting both word and subword tokenization. Ideal for Nepali NLP tasks such as language modeling, text classification, and more, addressing the specific needs of Nepali script and grammar
|
| 16 |
|
|
|
|
| 8 |
- microsoft/Phi-3.5-mini-instruct
|
| 9 |
---
|
| 10 |
|
|
|
|
|
|
|
|
|
|
| 11 |
## Model Details
|
| 12 |
A tokenizer designed for the Nepali language, supporting both word and subword tokenization. Ideal for Nepali NLP tasks such as language modeling, text classification, and more, addressing the specific needs of Nepali script and grammar
|
| 13 |
|