PEFT How to use Xiangchi/math_without_reason_13bf with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("src/output_prune/llama-13b-hf/rm_10_blocks")
model = PeftModel.from_pretrained(base_model, "Xiangchi/math_without_reason_13bf")