How to use tabeehive/tabeehive-ft with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TheBloke/Mistral-7B-Instruct-v0.2-GPTQ") model = PeftModel.from_pretrained(base_model, "tabeehive/tabeehive-ft")
b473977 928853f b473977
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:733b92a0cc12cfd6a9b7e7e5b9a04b697bc29edc87465832f28b3ec0b4051bbd size 5649
