---
title: "Next-token prediction on a real sequence"
emoji: 🧬
colorFrom: green
colorTo: yellow
sdk: static
pinned: false
---

# Next-token prediction on a real sequence

Standalone widget from the Carbon tokenization article. Embed via:

```html
<iframe src="https://huggingfacebio-carbon-tokenization-03-next-token-prediction.hf.space" loading="lazy"></iframe>
```

Generated from [`blog-preview.html`](https://github.com/HuggingFaceBio/carbon-tokenization) by `widgets/_extract.py` — edit the source there, not here.