Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

tgsc
/

BPE-tokenizer-32k

Model card Files Files and versions

BPE-tokenizer-32k

1.37 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

tgsc's picture

Upload 3 files

1d44361 almost 3 years ago

.gitattributes

1.48 kB
initial commit almost 3 years ago
special_tokens_map.json

121 Bytes
Upload 3 files almost 3 years ago
tokenizer.json

1.37 MB
Upload 3 files almost 3 years ago
tokenizer_config.json

219 Bytes
Upload 3 files almost 3 years ago