Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

huzaib
/

prompt-tokenizer-1

Model card Files Files and versions

prompt-tokenizer-1

3.54 MB

1 contributor

History: 2 commits

huzaib's picture

Upload tokenizer

ccbb2e4 verified almost 2 years ago

.gitattributes

1.52 kB

initial commit almost 2 years ago
README.md

5.17 kB

Upload tokenizer almost 2 years ago
merges.txt

486 kB

Upload tokenizer almost 2 years ago
special_tokens_map.json

99 Bytes

Upload tokenizer almost 2 years ago
tokenizer.json

2.21 MB

Upload tokenizer almost 2 years ago
tokenizer_config.json

440 Bytes

Upload tokenizer almost 2 years ago
vocab.json

840 kB

Upload tokenizer almost 2 years ago