How to use AllenTAN/bloom-7b1-lora-tagger with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigscience/bloom-7b1") model = PeftModel.from_pretrained(base_model, "AllenTAN/bloom-7b1-lora-tagger")
librarian-bot