Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

KBLab
/

unigram-64k-pretok-small_data-tokenizer

Model card Files Files and versions

unigram-64k-pretok-small_data-tokenizer

4.14 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

robinq's picture

Upload tokenizer

540276f about 3 years ago

.gitattributes

1.48 kB
initial commit about 3 years ago
special_tokens_map.json

173 Bytes
Upload tokenizer about 3 years ago
tokenizer.json

4.14 MB
Upload tokenizer about 3 years ago
tokenizer_config.json

322 Bytes
Upload tokenizer about 3 years ago