How to use maitrix-org/Voila-Tokenizer with Transformers:
# Load model directly from transformers import AutoFeatureExtractor, AutoModel extractor = AutoFeatureExtractor.from_pretrained("maitrix-org/Voila-Tokenizer") model = AutoModel.from_pretrained("maitrix-org/Voila-Tokenizer")