openeurollm/tokenizer-256k
Updated • 2
Edit Models filters
Model Tree
Apps
Inference Providers
Models
168
Active filters: sentencepiece
naclbit/gpt-j-japanese-6.8b
Text Generation • Updated • 7 • 28
IDEA-CCNL/Randeng-T5-77M
Updated • 32 • 4
IDEA-CCNL/Randeng-T5-784M
Updated • 20 • 12
IDEA-CCNL/Randeng-T5-784M-MultiTask-Chinese
0.8B • Updated • 118 • 75
IDEA-CCNL/Randeng-T5-77M-MultiTask-Chinese
77.4M • Updated • 134 • 26
IDEA-CCNL/Randeng-T5-Char-57M-Chinese
Updated • 8
mkshing/novelai-tokenizer-v1
Updated
NovelAI/nerdstash-tokenizer-v1
Updated • 8
NovelAI/nerdstash-tokenizer-v2
Updated • 8
if001/sentencepiece_ja
Updated • 2
shantipriya/OdiaTokenizer
Updated • 2 • 1
metinovadilet/kyrgyz_t5_tokenizer
Updated
Namuun123/mn_sentencepiece_tokenizer
Updated
Hanbaike/kyrgyz_bpe_16000
Updated
Hanbaike/kyrgyz_bpe_24000
Updated
Hanbaike/kyrgyz_bpe_32000
Updated
Hanbaike/kyrgyz_bpe_4000
Updated
Hanbaike/kyrgyz_bpe_51200
Updated
Hanbaike/kyrgyz_bpe_8000
Updated
Hanbaike/kyrgyz_unigram_16000
Updated
Hanbaike/kyrgyz_unigram_24000
Updated
Hanbaike/kyrgyz_unigram_32000
Updated
Hanbaike/kyrgyz_unigram_4000
Updated
Hanbaike/kyrgyz_unigram_51200
Updated
Hanbaike/kyrgyz_unigram_8000
Updated
Hanbaike/kyrgyz_spm_tokenizer
Updated
mrcha033/YunMin-tokenizer-96k
Text Generation • Updated • 5
Hailay/MachineT_TigEng
76.5M • Updated • 93 • 1
LocalDoc/az-en-unigram-tokenizer-50k
Updated • 1