Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Soldier-Boy
/
twitch-tokenizer
like
0
English
none
tokenizer
bpe
twitch
chat
nlp
License:
mit
Model card
Files
Files and versions
xet
Community
main
twitch-tokenizer
1.43 MB
1 contributor
History:
6 commits
Soldier-Boy
Add README
be5f8fc
verified
3 months ago
.gitattributes
1.52 kB
initial commit
3 months ago
README.md
4.22 kB
Add README
3 months ago
bpe_merges.txt
683 kB
Add bpe_merges.txt
3 months ago
bpe_vocab.json
744 kB
Add bpe_vocab.json
3 months ago
tokenizer_config.json
478 Bytes
Add tokenizer_config.json
3 months ago