3morixd commited on
Commit
0285034
Β·
verified Β·
1 Parent(s): 550b539

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +14 -5
README.md CHANGED
@@ -1,13 +1,22 @@
1
  ---
2
  title: Tokenizer Visualizer
3
- emoji: πŸƒ
4
- colorFrom: gray
5
  colorTo: purple
6
  sdk: gradio
7
- sdk_version: 6.19.0
8
- python_version: '3.13'
9
  app_file: app.py
10
  pinned: false
 
 
11
  ---
12
 
13
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
1
  ---
2
  title: Tokenizer Visualizer
3
+ emoji: πŸ”€
4
+ colorFrom: blue
5
  colorTo: purple
6
  sdk: gradio
7
+ sdk_version: "4.44.0"
 
8
  app_file: app.py
9
  pinned: false
10
+ license: apache-2.0
11
+ tags: [tokenizer, visualization, mcp, dispatchai]
12
  ---
13
 
14
+ # πŸ”€ dispatchAI Tokenizer Visualizer
15
+
16
+ **MCP Server** β€” visualize how tokenizers split text.
17
+
18
+ ## Tools
19
+ - `tokenize_text(text, method)` β€” Tokenize with chosen method
20
+ - `compare_methods(text)` β€” Compare token counts across methods
21
+
22
+ πŸš€ [dispatchAI](https://huggingface.co/dispatchAI)