How to use pcuenq/ministral-tokenizer-wip-untested with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("pcuenq/ministral-tokenizer-wip-untested", dtype="auto")
