timchen0618/OpinionQA
Viewer • Updated • 1.18k • 207 • 3
How to use timchen0618/Mistral_BERDS_evaluator with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2")
model = PeftModel.from_pretrained(base_model, "timchen0618/Mistral_BERDS_evaluator")Base model
mistralai/Mistral-7B-Instruct-v0.2
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2") model = PeftModel.from_pretrained(base_model, "timchen0618/Mistral_BERDS_evaluator")