How to use Honkware/30B-Lazarus-Landmark-QLoRA with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/home/ubuntu/hf-cache/models--CalderaAI--30B-Lazarus/snapshots/24da9e88f2b2b7946bc6fe9412d6728b9adc2c3d") model = PeftModel.from_pretrained(base_model, "Honkware/30B-Lazarus-Landmark-QLoRA")
