How to use jmcinern/qwen_tokenizer_ga_multilingual with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jmcinern/qwen_tokenizer_ga_multilingual", dtype="auto")
