Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

mehdie
/

BPE-tokenizer

Model card Files Files and versions

2.36 MB

1 contributor

History: 4 commits

morten-j's picture

Update README.md

7d16188 verified over 1 year ago

.gitattributes
1.52 kB

initial commit almost 2 years ago
README.md
3.87 kB

Update README.md over 1 year ago
special_tokens_map.json
125 Bytes

Upload tokenizer almost 2 years ago
tokenizer.json
2.35 MB

Upload tokenizer almost 2 years ago
tokenizer_config.json
240 Bytes

Upload tokenizer almost 2 years ago