Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

KBLab
/

bpe-32k-no_pretok-small_data-tokenizer

Model card Files Files and versions

bpe-32k-no_pretok-small_data-tokenizer

1.39 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

robinq's picture

Upload tokenizer

c4c1283 about 3 years ago

.gitattributes

1.48 kB
initial commit about 3 years ago
special_tokens_map.json

173 Bytes
Upload tokenizer about 3 years ago
tokenizer.json

1.39 MB
Upload tokenizer about 3 years ago
tokenizer_config.json

329 Bytes
Upload tokenizer about 3 years ago