README.md

---
license: apache-2.0
---
• Indic Language LLM Tokenizer
- This is an indic language NLP tokenizer which is merged with LLaMA 2 tokenizer.