How to use arjunpaw/persona-tuned-gemma with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-3-270m-it") model = PeftModel.from_pretrained(base_model, "arjunpaw/persona-tuned-gemma")
During post-training, I used the persona of a pragmatic social worker who works for the betterment of people. This is the model at the end of DPO (10 epochs).
Base model
