Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
shwethd
/
kannada-tokenizer-50k
like
0
Kannada
tokenizers
tokenizer
bpe
kannada
indic
subword
License:
mit
Model card
Files
Files and versions
xet
Community
main
kannada-tokenizer-50k
4.55 MB
1 contributor
History:
2 commits
shwethd
Upload 5 files
ae75114
verified
about 2 months ago
.gitattributes
1.52 kB
initial commit
about 2 months ago
README.md
7.55 kB
Upload 5 files
about 2 months ago
metadata.json
149 Bytes
Upload 5 files
about 2 months ago
tokenizer.json
4.54 MB
Upload 5 files
about 2 months ago
tokenizer_config.json
274 Bytes
Upload 5 files
about 2 months ago
validation_results.json
321 Bytes
Upload 5 files
about 2 months ago