Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
flexitok 's Collections
4000-vocab
16000-vocab
fineweb2-hq-tokenizers-feat2
flexitok-mod-tokenizers-zero-padded
flexitok/mod-tokenizers
flexitok/fineweb2-hq-superset-tokenizers
Fineweb2-HQ-Tokenizers
merging-toksuite
baselines

4000-vocab

updated about 4 hours ago
Upvote
-

  • flexitok/bpe_vie_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_swe_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_dan_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_hun_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_tur_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_ell_Grek_4000

    Updated about 4 hours ago

  • flexitok/bpe_ces_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_ind_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_nld_Latn_4000

    Updated about 4 hours ago

  • flexitok/bpe_pol_Latn_4000

    Updated about 4 hours ago
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs