How to use jadechoghari/tokenizer-lib-mean with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jadechoghari/tokenizer-lib-mean", dtype="auto")
