| title: "Prefix ambiguity, in a vocabulary that holds five plausible next tokens" | |
| emoji: 🧬 | |
| colorFrom: green | |
| colorTo: yellow | |
| sdk: static | |
| pinned: false | |
| # Prefix ambiguity, in a vocabulary that holds five plausible next tokens | |
| Standalone widget from the Carbon tokenization article. Embed via: | |
| ```html | |
| <iframe src="https://huggingfacebio-carbon-tokenization-01-prefix-ambiguity.hf.space" loading="lazy"></iframe> | |
| ``` | |
| Generated from [`blog-preview.html`](https://github.com/HuggingFaceBio/carbon-tokenization) by `widgets/_extract.py` — edit the source there, not here. | |