Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Edit Models filters

Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
Jellybox
JoyFusion
LocalAI
vLLM
Ollama
TGI
MLX LM
Docker Model Runner
Lemonade
Inference Providers
Groq
Novita
Nebius AI
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
Misc
subword
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Mixture of Experts
Carbon Emissions

Models

10
Full-text search
Active filters: subword

aayushraina/hindi-bpe-tokenizer

Text Generation • Updated Jan 11

aayushraina/bpe-hindi

Text Generation • Updated Jan 11

ZombitX64/Thaitokenizer

Updated Aug 22

khopilot/km-tokenizer-khmer

Feature Extraction • Updated Aug 21 • 12 • 3

toksuite/supertoken_models-llama_tokenmonster-englishcode-32000-consistent-v1

Text Generation • 1B • Updated 1 day ago • 48

Shu-vi/Russian_BPE_Tokenizer_16k

Updated Oct 10

Shu-vi/Russian_wordpiece_tokenizer_32k

Updated Oct 10

Shu-vi/Russian_Unigram_Tokenizer_16k

Updated Oct 10

phmd/TinyStories-SRL-5M

Text Generation • Updated Oct 12 • 16

shwethd/kannada-tokenizer-50k

Updated Nov 13
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs