How to use uditjain/Nemotron-30B-Math-Instruct-LoRI with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16") model = PeftModel.from_pretrained(base_model, "uditjain/Nemotron-30B-Math-Instruct-LoRI")
The community tab is the place to discuss and collaborate with the HF community!