How to use haraygese/fastchat with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("lmsys/fastchat-t5-3b-v1.0") model = PeftModel.from_pretrained(base_model, "haraygese/fastchat")
pipeline_tag: text-generation library_name: peft
