How to use devngho/non-jamo-tokenizer-exp1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("devngho/non-jamo-tokenizer-exp1", dtype="auto")
