Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ArthaLabs
/
panini-tokenizer
like
0
Transformers
Sanskrit
sanskrit
tokenizer
nlp
morphology
linguistics
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
panini-tokenizer
6.78 MB
1 contributor
History:
12 commits
ArthaLabs
Upload src/splitter.py with huggingface_hub
e1cd59b
verified
6 days ago
src
Upload src/splitter.py with huggingface_hub
6 days ago
.gitattributes
1.52 kB
initial commit
7 days ago
BENCHMARKS.md
11.8 kB
Upload folder using huggingface_hub
7 days ago
README.md
3.74 kB
Upload folder using huggingface_hub
7 days ago
app.py
8.32 kB
Upload folder using huggingface_hub
6 days ago
requirements.txt
69 Bytes
Upload folder using huggingface_hub
7 days ago
special_tokens_map.json
180 Bytes
Upload folder using huggingface_hub
7 days ago
stems.json
3 MB
Upload folder using huggingface_hub
7 days ago
tokenizer_config.json
348 Bytes
Upload folder using huggingface_hub
7 days ago
tokenizer_hf.py
4.41 kB
Upload tokenizer_hf.py with huggingface_hub
6 days ago
vocab.json
3.64 MB
Upload folder using huggingface_hub
7 days ago
