How to use cfli/minicpm_mixture with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("openbmb/MiniCPM-2B-dpo-fp32") model = PeftModel.from_pretrained(base_model, "cfli/minicpm_mixture")
cfli commited on 