How to use comhu/axlight-4.0-light-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("skt/A.X-4.0-Light") model = PeftModel.from_pretrained(base_model, "comhu/axlight-4.0-light-lora")
