Spaces:
Sleeping
Sleeping
Debanjum
commited on
Commit
·
d8a31af
1
Parent(s):
ef61a64
Improve page icon, app name, styling and readme
Browse files- README.md +4 -4
- static/khoj.png +0 -0
- templates/index.html +3 -3
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
colorFrom: purple
|
| 5 |
colorTo: blue
|
| 6 |
sdk: docker
|
|
@@ -8,9 +8,9 @@ pinned: false
|
|
| 8 |
license: mit
|
| 9 |
---
|
| 10 |
|
| 11 |
-
#
|
| 12 |
|
| 13 |
-
A web app to visualize tokenization
|
| 14 |
|
| 15 |
## Features
|
| 16 |
|
|
|
|
| 1 |
---
|
| 2 |
+
title: Token Visualizer
|
| 3 |
+
emoji: 🖋️
|
| 4 |
colorFrom: purple
|
| 5 |
colorTo: blue
|
| 6 |
sdk: docker
|
|
|
|
| 8 |
license: mit
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Token Visualizer
|
| 12 |
|
| 13 |
+
A web app to visualize text tokenization by any LLM hosted on HuggingFace. Inspired by OpenAI's tokenizer tool.
|
| 14 |
|
| 15 |
## Features
|
| 16 |
|
static/khoj.png
ADDED
|
templates/index.html
CHANGED
|
@@ -318,8 +318,8 @@
|
|
| 318 |
</head>
|
| 319 |
<body>
|
| 320 |
<div class="container">
|
| 321 |
-
<h1
|
| 322 |
-
<p class="subtitle">Visualize tokenization
|
| 323 |
|
| 324 |
<div class="card">
|
| 325 |
<div class="input-group">
|
|
@@ -378,7 +378,7 @@
|
|
| 378 |
</div>
|
| 379 |
|
| 380 |
<footer>
|
| 381 |
-
|
| 382 |
</footer>
|
| 383 |
</div>
|
| 384 |
|
|
|
|
| 318 |
</head>
|
| 319 |
<body>
|
| 320 |
<div class="container">
|
| 321 |
+
<h1>🖋️ Token Visualizer</h1>
|
| 322 |
+
<p class="subtitle">Visualize tokenization of text by any LLM</p>
|
| 323 |
|
| 324 |
<div class="card">
|
| 325 |
<div class="input-group">
|
|
|
|
| 378 |
</div>
|
| 379 |
|
| 380 |
<footer>
|
| 381 |
+
<a href="https://github.com/khoj-ai" target="_blank" rel="noopener noreferrer"><img src="/static/khoj.png" alt="Khoj" style="height: 16px; vertical-align: middle; margin-right: 4px;">Khoj AI</a>
|
| 382 |
</footer>
|
| 383 |
</div>
|
| 384 |
|