PEFT How to use Calvin-Xu/FLFL-Adapter with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("stockmark/gpt-neox-japanese-1.4b")
model = PeftModel.from_pretrained(base_model, "Calvin-Xu/FLFL-Adapter")