Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

gartland
/

openwebtext-98K-tokenizer

Model card Files Files and versions

openwebtext-98K-tokenizer

9.61 MB

1 contributor

History: 2 commits

gartland's picture

Upload tokenizer

e6c92c1 verified 11 months ago

.gitattributes

1.52 kB

initial commit 11 months ago
README.md

5.17 kB

Upload tokenizer 11 months ago
merges.txt

934 kB

Upload tokenizer 11 months ago
special_tokens_map.json

99 Bytes

Upload tokenizer 11 months ago
tokenizer.json

7.06 MB

Upload tokenizer 11 months ago
tokenizer_config.json

471 Bytes

Upload tokenizer 11 months ago
vocab.json

1.61 MB

Upload tokenizer 11 months ago