Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Shu-vi
/
Russian_BPE_Tokenizer_16k
like
0
4 datasets
Russian
tokenizers
tokenizer
BPE
subword
russian
custom
License:
mit
Model card
Files
Files and versions
xet
Community
main
Russian_BPE_Tokenizer_16k
1.66 MB
1 contributor
History:
5 commits
Shu-vi
Upload tokenizer.json
175d625
verified
3 months ago
.gitattributes
1.52 kB
initial commit
3 months ago
README.md
2.09 kB
Update README.md
3 months ago
bpe_v16000_minf3.json
826 kB
Upload bpe_v16000_minf3.json
3 months ago
tokenizer.json
826 kB
Upload tokenizer.json
3 months ago