Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

chetanpun
/

devanagari-tokenizer

Model card Files Files and versions

devanagari-tokenizer

1.91 MB

1 contributor

History: 4 commits

chetanpun's picture

Update README.md

d55ec41 verified over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

524 Bytes

Update README.md over 1 year ago
added_tokens.json

34.6 kB

Upload processor over 1 year ago
merges.txt

494 kB

Upload processor over 1 year ago
normalizer.json

52.7 kB

Upload processor over 1 year ago
preprocessor_config.json

340 Bytes

Upload processor over 1 year ago
special_tokens_map.json

2.19 kB

Upload processor over 1 year ago
tokenizer_config.json

283 kB

Upload processor over 1 year ago
vocab.json

1.04 MB

Upload processor over 1 year ago