yakul259/english-unigram-tokenizer-60k
Updated
Edit Models filters
Apps
Inference Providers
Active filters:
tokenizer
yakul259/english-bpe-tokenizer-60k
Updated
yakul259/finance-bpe-tokenizer-30k
Updated
yakul259/finance-wordpiece-tokenizer-30k
Updated
yakul259/finance-unigram-tokenizer-30k
Updated
Utkarshg02/my-wav2vec2-processor
Updated
janakhpon/mon_tokenizer
Text Generation
•
Updated
•
1
yasserius/bangla-tokenizer
Updated
ZombitX64/zombitx64-thaitokenizer
Updated
MustafaSeker/sugartrq-tokenizer-tr
Updated
uzlm/alloma-1B-Instruct
Text Generation
•
1B
•
Updated
•
43
•
5
uzlm/alloma-3B-Instruct
Text Generation
•
3B
•
Updated
•
29
•
5
LingoIITGN/Ansh-160k
Updated
•
2
•
2
Mavkif/m2m100_rup_tokenizer_both
Updated
nursimakgul/turkish-tokenizer
Updated
GoshKolotyan/perovskite-formula-tokenizer
Feature Extraction
•
Updated
uzlm/alloma-8B-Instruct
Text Generation
•
8B
•
Updated
•
147
•
7
nursimakgul/turkish-fen-tokenizer-v1
Updated
SonyCSLParis/codicodec
Updated
•
3
XuejiFang/UniTok_transformers
Image-to-Image
•
0.8B
•
Updated
•
9
Sai5480/tokenizer-iso-cluster-7-vocab-128000
Updated
Sai5480/tokenizer-iso-cluster-8-vocab-128000
Updated
gbyuvd/FastChemTokenizer
Feature Extraction
•
Updated
•
15
•
1
Rogarcia18/wikitext2-bpe-tokenizer
Updated
robotics-diffusion-transformer/RVQActionTokenizer
Robotics
•
0.4B
•
Updated
•
1.05k
•
2
Sai5480/monolingual-tokenizer-native-asm-vocab-128000
Updated
Sai5480/monolingual-tokenizer-native-ben-vocab-128000
Updated
Sai5480/monolingual-tokenizer-native-gom-vocab-128000
Updated
Sai5480/monolingual-tokenizer-native-guj-vocab-128000
Updated
Sai5480/monolingual-tokenizer-native-hin-vocab-128000
Updated