PEFT How to use akpon900/dream-instruct-rainbow with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Dream-org/Dream-v0-Instruct-7B")
model = PeftModel.from_pretrained(base_model, "akpon900/dream-instruct-rainbow")
