PEFT How to use YiyangAiLab/llava_POVID_stage_one_lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/data/yiyang_zhou/workplace/LLaVA/checkpoint/llava-v1.5-7b/")
model = PeftModel.from_pretrained(base_model, "YiyangAiLab/llava_POVID_stage_one_lora")