---
title: Some Tokenizers
emoji: ✂️
colorFrom: red
colorTo: yellow
sdk: static
pinned: false
license: mit
short_description: Tokenize text using some obscure-ish tokenizers
---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference