Instructions to use axentx/surrogate-2-tokenizer-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use axentx/surrogate-2-tokenizer-v2 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("axentx/surrogate-2-tokenizer-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- bf45c5b7439a73070dd8b699d21e9c86511904890826fe4a329a0bb9df1b531b
- Size of remote file:
- 20 MB
- SHA256:
- 368beaf5820a84867b1691b05fce9ba071fe561be1a00f7b32e038e81f2628fe
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.