PEFT How to use Fischerboot/sophie-improved with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Fischerboot/LLama3-Lexi-Aura-3Some-SLERP-SLERP-ql-merge")
model = PeftModel.from_pretrained(base_model, "Fischerboot/sophie-improved")