How to use ashishpatel26/bloomz-560m-tagger with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigscience/bloomz-560m") model = PeftModel.from_pretrained(base_model, "ashishpatel26/bloomz-560m-tagger")
Srinu1093