Instructions to use EmnaBou/TD-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EmnaBou/TD-tokenizer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="EmnaBou/TD-tokenizer")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("EmnaBou/TD-tokenizer") model = AutoModelForTokenClassification.from_pretrained("EmnaBou/TD-tokenizer") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 5d72e540e183b8c117d99df097a4b2d474e3a39cc7bef138ad406272ac0bdd0d
- Size of remote file:
- 434 MB
- SHA256:
- 1366badef45d08a4fb94a07239c8300ff6adf70bbc9a8d1c7ad7a31e79829ed9
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.