timdettmers/openassistant-guanaco
Viewer • Updated • 10.4k • 4.72k • 442
How to use sadiakanwal/LLM-Assistant with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("TinyPixel/Llama-2-7B-bf16-sharded")
model = PeftModel.from_pretrained(base_model, "sadiakanwal/LLM-Assistant")Base model
TinyPixel/Llama-2-7B-bf16-sharded