bashyaldhiraj2067
/

nepali-bpe-tokenizer

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Nepali BPE Tokenizer

This tokenizer was trained on the bashyaldhiraj2067/500k_copy_error_dataset, which contains Nepali text data with both correct and incorrect examples.

Details

Tokenizer type: BPE (Byte-Pair Encoding)
Vocabulary size: 50,000
Minimum frequency: 2
Special tokens: , , , ,

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support