How to use Balab2021/Nemotron-Mini-4B-LoRA-OpenAssistant with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("nvidia/Nemotron-Mini-4B-Instruct") model = PeftModel.from_pretrained(base_model, "Balab2021/Nemotron-Mini-4B-LoRA-OpenAssistant")
cdb9135 60a1da3 cdb9135
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:9f2b8ec66f93ee45cc3fa733677d28195edfd61f34c0b92fa39400e4a77e42ba size 5841
