How to use PranavBP525/reward_model_outputs with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("microsoft/phi-2") model = PeftModel.from_pretrained(base_model, "PranavBP525/reward_model_outputs")
