PEFT How to use Hi-Satoh/adv_MoE_ALF_dpo3_adapter with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")
model = PeftModel.from_pretrained(base_model, "Hi-Satoh/adv_MoE_ALF_dpo3_adapter") 
