How to use BayanDuygu/tokenizer-llama8b-rawtext with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("BayanDuygu/tokenizer-llama8b-rawtext", dtype="auto")
