Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

divyanshu94
/

gujarati_tokenizer-v2

Model card Files Files and versions

gujarati_tokenizer-v2

111 MB

1 contributor

History: 2 commits

divyanshu94's picture

second push - updated_tokenizer

979d811 verified 8 months ago

.gitattributes
1.63 kB

second push - updated_tokenizer 8 months ago
README.md
5.17 kB

second push - updated_tokenizer 8 months ago
added_tokens.json
17.5 MB
xet

second push - updated_tokenizer 8 months ago
chat_template.jinja
462 Bytes

second push - updated_tokenizer 8 months ago
merges.txt
917 kB

second push - updated_tokenizer 8 months ago
special_tokens_map.json
575 Bytes

second push - updated_tokenizer 8 months ago
tokenizer_config.json
90.8 MB
xet

second push - updated_tokenizer 8 months ago
vocab.json
2.01 MB

second push - updated_tokenizer 8 months ago