Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
deshanksuman
/
romanized-sinhala-tokenizer
like
0
deshanksuman/Swabhasha_RomanizedSinhala_Dataset
Sinhala
romanized-sinhala
tokenizer
mbart
seq2seq
arxiv:
2507.09245
License:
mit
Model card
Files
Files and versions
xet
Community
main
romanized-sinhala-tokenizer
6.97 MB
1 contributor
History:
5 commits
deshanksuman
Update README.md
2bb431c
verified
3 months ago
.gitattributes
1.52 kB
initial commit
8 months ago
README.md
1.4 kB
Update README.md
3 months ago
special_tokens_map.json
7.53 kB
Upload tokenizer
8 months ago
tokenizer.json
6.95 MB
Upload tokenizer
8 months ago
tokenizer_config.json
10.8 kB
Upload tokenizer
8 months ago