How to use josephmayo/Holo-3.1-4B-Coder-LoRA with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Hcompany/Holo-3.1-4B") model = PeftModel.from_pretrained(base_model, "josephmayo/Holo-3.1-4B-Coder-LoRA")
josephmayo commited on 