Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Model Tree
Base
Adapters
Finetunes
Quantizations
Merges
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
JoyFusion
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Unsloth Studio
Pi
Hermes Agent
Atomic Chat
OpenClaw
Inference Providers
Select all
Groq
Novita
Cerebras
Nscale
fal
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
DeepInfra
Misc
Reset Misc
tokenizer
Inference Endpoints
text-generation-inference
Eval Results (legacy)
text-embeddings-inference
custom_code
4-bit precision
Merge
8-bit precision
Mixture of Experts
Carbon Emissions
Eval Results
Apply filters
Models
1,369
Base only
Inference Available
Inference
Edit filters
Sort: Trending
Active filters:
tokenizer
Clear all
Morton-Li/QiYuanTokenizer-Medium
Updated
Mar 14
Morton-Li/QiYuanTokenizer-Small
Updated
Mar 14
Morton-Li/QiYuanTokenizer-Tiny
Updated
Mar 14
AraFusion/arafusion-vanillaBPE
Updated
Mar 15
aakashMeghwar01/SindhiLM-Tokenizer-v1
Updated
Mar 16
adityaghai07/ag_hindi_bpe_tokenizer_32k
Updated
Mar 15
adityaghai07/ag_hindi_uni_tokenizer_32k
Updated
Mar 15
aakashMeghwar01/SindhiNLTK
Updated
Mar 24
•
1
nmstech/turk-tokenizer
Updated
Mar 16
aakashMeghwar01/SindhiLM-Tokenizer-v2
Updated
Mar 17
piyazon/uyghur-text-tokenizer
Updated
Mar 18
Minuri/sinhala-llama-3.2-1b-tokenizer
Updated
Apr 4
TuKoResearch/WavCochCausalV64000100M
Feature Extraction
•
93M
•
Updated
Mar 19
TTS-AGI/DACVAE-RVQ-vocab16k-400-hz
Updated
Mar 21
•
2
AxiomicLabs/GPT-X2-TOK-32K
Updated
Apr 14
•
1
zxc0zxc0zxc/gigachat-nanai-extended-tokenizer
Updated
Mar 24
zxc0zxc0zxc/gigachat-nanai-retrained-tokenizer
Updated
Mar 24
Ailaysa-AI/asai-tokenizer-model
Updated
Mar 26
•
6
hwh-datascience/divae-tokenizer-rgb-448
Updated
Mar 26
•
3
hwh-datascience/divae-tokenizer-cir-448
Updated
Mar 26
•
3
hwh-datascience/divae-tokenizer-ahn-448
Updated
Mar 26
•
5
jojonocode/strive-ewe-xlmr-hybrid-tokenizer
Updated
Mar 27
•
1
romizone/bpe-tokenizer-id
Token Classification
•
Updated
Mar 29
wy9935002/fast
Robotics
•
Updated
Mar 31
eugenehp/NeuroRVQ
Feature Extraction
•
Updated
Mar 31
•
7
•
1
appautomaton/openmoss-audio-tokenizer-mlx
Feature Extraction
•
Updated
Apr 11
mlx-community/MOSS-Audio-Tokenizer-MLX-8bit
Feature Extraction
•
Updated
Apr 11
CMSManhattan/LlamaRoboticsTokenizer
Robotics
•
Updated
8 days ago
•
2
srinivas-652/gpt-oss-120b-tokenizer
Text Generation
•
Updated
Apr 1
•
6
•
1
assemsabry/traum-tokenizer
Token Classification
•
Updated
Apr 2
•
2
Previous
1
...
27
28
29
30
31
...
46
Next