How to use uditjain/Nemotron-30B-Science-Instruct-LoRI with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16") model = PeftModel.from_pretrained(base_model, "uditjain/Nemotron-30B-Science-Instruct-LoRI")
uditjain commited on 