Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ArthaLabs
/
panini-tokenizer
like
0
Transformers
Sanskrit
sanskrit
tokenizer
nlp
morphology
linguistics
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
panini-tokenizer
/
src
118 kB
1 contributor
History:
6 commits
ArthaLabs
Upload src/splitter.py with huggingface_hub
e1cd59b
verified
about 2 months ago
__pycache__
Upload folder using huggingface_hub
about 2 months ago
__init__.py
497 Bytes
Upload folder using huggingface_hub
about 2 months ago
analyzer.py
14.5 kB
Upload folder using huggingface_hub
about 2 months ago
sandhi_engine.py
4.28 kB
Upload folder using huggingface_hub
about 2 months ago
splitter.py
39.6 kB
Upload src/splitter.py with huggingface_hub
about 2 months ago
tokenizer.py
19.6 kB
Upload folder using huggingface_hub
about 2 months ago