flexitok/bpe_cmn_Hani_64000
Updated
Edit Models filters
Apps
Inference Providers
Active filters: tokenizer
flexitok/bpe_pol_Latn_128000
Updated
flexitok/bpe_swe_Latn_128000
Updated
flexitok/bpe_vie_Latn_64000
Updated
flexitok/unigram_pol_Latn_32000
Updated
flexitok/unigram_deu_Latn_32000
Updated
flexitok/unigram_fw_edu_128000
Updated
flexitok/unigram_nld_Latn_16000
Updated
flexitok/unigram_rus_Cyrl_32000
Updated
flexitok/unigram_fas_Arab_32000
Updated
flexitok/unigram_por_Latn_128000
Updated
flexitok/unigram_arb_Arab_128000
Updated
flexitok/unigram_rus_Cyrl_128000
Updated
flexitok/unigram_dan_Latn_128000
Updated
flexitok/bpe_dan_Latn_32000
Updated
flexitok/unigram_swe_Latn_32000
Updated
flexitok/bpe_pol_Latn_64000
Updated
flexitok/bpe_nld_Latn_32000
Updated
flexitok/bpe_jpn_Jpan_64000
Updated
flexitok/unigram_dan_Latn_16000
Updated
flexitok/unigram_deu_Latn_64000
Updated
flexitok/unigram_vie_Latn_64000
Updated
flexitok/unigram_ita_Latn_64000
Updated
flexitok/bpe_vie_Latn_128000
Updated
flexitok/unigram_por_Latn_64000
Updated
flexitok/unigram_tur_Latn_64000
Updated
flexitok/unigram_cmn_Hani_128000
Updated
flexitok/unigram_jpn_Jpan_32000
Updated
flexitok/bpe_fas_Arab_64000
Updated
flexitok/bpe_por_Latn_128000
Updated