Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

lemon-mint
/

ko-tokenizer-experiment-003

Model card Files Files and versions

ko-tokenizer-experiment-003

5.33 MB

1 contributor

History: 2 commits

lemon-mint's picture

Upload tokenizer

6d0361d verified almost 2 years ago

.gitattributes

1.52 kB

initial commit almost 2 years ago
README.md

5.17 kB

Upload tokenizer almost 2 years ago
merges.txt

840 kB

Upload tokenizer almost 2 years ago
special_tokens_map.json

441 Bytes

Upload tokenizer almost 2 years ago
tokenizer.json

3.2 MB

Upload tokenizer almost 2 years ago
tokenizer_config.json

621 Bytes

Upload tokenizer almost 2 years ago
vocab.json

1.28 MB

Upload tokenizer almost 2 years ago