Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Shu-vi
/
Russian_BPE_Tokenizer_16k

Russian
tokenizers
tokenizer
BPE
subword
russian
custom
Model card Files Files and versions
xet
Community
Russian_BPE_Tokenizer_16k
1.66 MB
  • 1 contributor
History: 5 commits
Shu-vi's picture
Shu-vi
Upload tokenizer.json
175d625 verified 3 months ago
  • .gitattributes
    1.52 kB
    initial commit 3 months ago
  • README.md
    2.09 kB
    Update README.md 3 months ago
  • bpe_v16000_minf3.json
    826 kB
    Upload bpe_v16000_minf3.json 3 months ago
  • tokenizer.json
    826 kB
    Upload tokenizer.json 3 months ago