Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
PraneetNS
/
indic-tokenizer-v2-2
like
1
Model card
Files
Files and versions
xet
Community
main
indic-tokenizer-v2-2
2.27 MB
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
PraneetNS
Upload folder using huggingface_hub
8d85ec0
verified
28 days ago
.gitattributes
Safe
1.52 kB
initial commit
28 days ago
README.md
492 Bytes
Upload folder using huggingface_hub
28 days ago
special_tokens_map.json
85 Bytes
Upload folder using huggingface_hub
28 days ago
tokenizer.model
2.26 MB
xet
Upload folder using huggingface_hub
28 days ago
tokenizer.py
841 Bytes
Upload folder using huggingface_hub
28 days ago
tokenizer_config.json
947 Bytes
Upload folder using huggingface_hub
28 days ago