How to use SNV/xwin-finetuned-alpaca-cleaned with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TheBloke/Xwin-LM-7B-V0.1-GPTQ") model = PeftModel.from_pretrained(base_model, "SNV/xwin-finetuned-alpaca-cleaned")
