How to use anyiwang/mistral_5 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("ybelkada/mistral-7b-instruct-v0.1-sharded") model = PeftModel.from_pretrained(base_model, "anyiwang/mistral_5")
