| Crates.io | |
| ---------------------------------------------------------------------------------------------------- | |
| 🤗 Tokenizers is available on `crates.io <https://crates.io/crates/tokenizers>`__. | |
| You just need to add it to your :obj:`Cargo.toml`:: | |
| tokenizers = "0.10" | |