Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
shantipriya
/
OdiaTokenizer
like
1
OdiaGenAIdata/pre_train_odia_data_processed
Oriya
sentencepiece
License:
cc-by-nc-sa-4.0
Model card
Files
Files and versions
xet
Community
main
OdiaTokenizer
2.68 MB
1 contributor
History:
7 commits
shantipriya
Create tokenizer_config.json
ca15fcc
verified
about 1 year ago
.gitattributes
1.52 kB
initial commit
about 1 year ago
README.md
3.42 kB
Update README.md
about 1 year ago
config.json
248 Bytes
Create config.json
about 1 year ago
odia_tokenizers_test.model
1.37 MB
xet
Add SentencePiece tokenizer model for Odia
about 1 year ago
odia_tokenizers_test.vocab
1.3 MB
Add SentencePiece tokenizer model for Odia
about 1 year ago
tokenizer_config.json
245 Bytes
Create tokenizer_config.json
about 1 year ago
