How to use ciphermosaic/phi-3.5-oasst1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3.5-mini-instruct") model = PeftModel.from_pretrained(base_model, "ciphermosaic/phi-3.5-oasst1")
How to use ciphermosaic/phi-3.5-oasst1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ciphermosaic/phi-3.5-oasst1", device_map="auto")
How to fix it?
