Instructions to use tarsssss/bj-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tarsssss/bj-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("tarsssss/bj-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload tokenizer
Verified signature5fc0cec -
Upload tokenizer
Verified signature2ecc3a7 -
Upload tokenizer
Verified signaturee664806 -
Upload tokenizer
Verified signatureed1bdc4 -
Upload tokenizer
Verified signaturec106449 -
initial commit
Verified signature556e474