Model Details
A tokenizer designed for the Nepali language, supporting both word and subword tokenization. Ideal for Nepali NLP tasks such as language modeling, text classification, and more, addressing the specific needs of Nepali script and grammar
Model Description
- Developed by: Universalml Inc.
- Funded by : AWS , DigitalOcean
- Language(s) (NLP): Nepali
- License: MIT
- Finetuned from model optional: microsoft/Phi-3.5-mini-instruct
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for universalml/Nepali_Tokenizer
Base model
microsoft/Phi-3.5-mini-instruct
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("universalml/Nepali_Tokenizer", dtype="auto")