PEFT How to use Roner1/LLaMA-Colosal-NeuroIPS with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("hpcai-tech/Colossal-LLaMA-2-7b-base")
model = PeftModel.from_pretrained(base_model, "Roner1/LLaMA-Colosal-NeuroIPS")