Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

renyulin
/

my-new-shiny-tokenizer

Model card Files Files and versions

my-new-shiny-tokenizer

1 contributor

History: 2 commits

renyulin's picture

Upload tokenizer

5d1cd28 verified 12 months ago

.gitattributes
1.52 kB

initial commit 12 months ago
README.md
5.17 kB

Upload tokenizer 12 months ago
merges.txt
231 kB

Upload tokenizer 12 months ago
special_tokens_map.json
99 Bytes

Upload tokenizer 12 months ago
tokenizer.json
1.77 MB

Upload tokenizer 12 months ago
tokenizer_config.json
471 Bytes

Upload tokenizer 12 months ago
vocab.json
396 kB

Upload tokenizer 12 months ago