How to use smangrul/OpenHathi-7B-Hi-v0.1-Instruct with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("sarvamai/OpenHathi-7B-Hi-v0.1-Base") model = PeftModel.from_pretrained(base_model, "smangrul/OpenHathi-7B-Hi-v0.1-Instruct")
aman-rathour 
akashgoel-id