YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

# Example Code: State of Art Nepali Tokenizer

from transformers import AutoTokenizer

# Load the tokenizer directly from Hugging Face
tokenizer = AutoTokenizer.from_pretrained("krishnamishra8848/Nepali_Tokenizer")

# Test tokenization with some text
text = "तपाईंले आफ्ना लक्ष्यलाई प्राप्त गर्नका लागि मिहिनेत र धैर्यको महत्त्व बुझ्नुपर्छ।"
tokens = tokenizer(text)

print("Tokenized Output:", tokens)

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support