pandurangpatil
/

sample-marathi-bpe-tokenizer

Model card Files Files and versions

sample-marathi-bpe-tokenizer

701 kB

1 contributor

History: 8 commits

pandurangpatil's picture

Upload tokenizer.json with huggingface_hub

84060c4 verified about 2 months ago

.gitattributes
1.52 kB

initial commit about 2 months ago
README.md
2.93 kB

Upload README.md with huggingface_hub about 2 months ago
id_to_token.json
162 kB

Upload id_to_token.json with huggingface_hub about 2 months ago
merges.json
77.2 kB

Upload merges.json with huggingface_hub about 2 months ago
tokenizer.json
305 kB

Upload tokenizer.json with huggingface_hub about 2 months ago
tokenizer_config.json
117 Bytes

Upload tokenizer_config.json with huggingface_hub about 2 months ago
vocab.json
153 kB

Upload vocab.json with huggingface_hub about 2 months ago