How to use xiaojuntime/final-ppo with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("xiaojuntime/peft-merged") model = PeftModel.from_pretrained(base_model, "xiaojuntime/final-ppo")
21218a3
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:f0df05f613175bd8c9d672c9951910f9e8629e9a0c5e0f5914e9d220df4e63b9 size 69238585
