Hugging Face's logo

Spaces:
sanderland
/
claude-tokenizer
Running on Zero

App Files Community
sanderland commited on
Commit
f9f1aef
·
verified ·
1 Parent(s): 4c720a7

Separate adjacent byte markers

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -187,7 +187,7 @@ CSS = (
187
  /* Markers are strong-LTR letters; isolating them stops each one flipping the run around it. */
188
  .tk-tokens .mk {
189
  font-size: 0.75em; font-weight: 700; vertical-align: 0.1em; unicode-bidi: isolate;
190
- color: hsl(24 95% 36%); opacity: 0.85;
191
  }
192
  .dark .tk-tokens .mk { color: hsl(24 95% 66%); }
193
  .tk-more { font-size: 0.85em; opacity: 0.7; margin-top: 6px; }
 
187
  /* Markers are strong-LTR letters; isolating them stops each one flipping the run around it. */
188
  .tk-tokens .mk {
189
  font-size: 0.75em; font-weight: 700; vertical-align: 0.1em; unicode-bidi: isolate;
190
+ color: hsl(24 95% 36%); opacity: 0.85; padding: 0 1px;
191
  }
192
  .dark .tk-tokens .mk { color: hsl(24 95% 66%); }
193
  .tk-more { font-size: 0.85em; opacity: 0.7; margin-top: 6px; }