How to use yuuhan/roberta-base-mnli-lora-layer0-5 with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("/home/sunyuhan/syh/sunyuhan/zju/roberta-base") model = PeftModel.from_pretrained(base_model, "yuuhan/roberta-base-mnli-lora-layer0-5")
MNLI acc: 0.8556291390728477
