Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Kashif786
/
ai4bharat-sindhi-tokenizer
like
0
Transformers
arxiv:
1910.09700
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
ai4bharat-sindhi-tokenizer
8.84 MB
1 contributor
History:
2 commits
Kashif786
Extend AI4Bharat with 20k Sindhi Unigram tokens
efb2979
verified
16 days ago
.gitattributes
Safe
1.52 kB
initial commit
16 days ago
README.md
Safe
5.17 kB
Extend AI4Bharat with 20k Sindhi Unigram tokens
16 days ago
tokenizer.json
8.83 MB
Extend AI4Bharat with 20k Sindhi Unigram tokens
16 days ago
tokenizer_config.json
406 Bytes
Extend AI4Bharat with 20k Sindhi Unigram tokens
16 days ago
