teknium/OpenHermes-2.5
Viewer • Updated • 1M • 19.5k • 891
How to use linlinlin/zephy_SFT_Hermes with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")
model = PeftModel.from_pretrained(base_model, "linlinlin/zephy_SFT_Hermes")A SFT version on Mistral-7B-v0.1 using dataset teknium/OpenHermes-2.5
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM
config = PeftConfig.from_pretrained("linlinlin/zephy_SFT_Hermes")
model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")
model = PeftModel.from_pretrained(model, "linlinlin/zephy_SFT_Hermes")
teknium/OpenHermes-2.5
RTX-4090
Ubuntu 22.04
Base model
mistralai/Mistral-7B-v0.1