How to use quasar529/cola-deberta_initialize_dW_B_with_svd_from_back_dW_A_zero with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("microsoft/deberta-v2-xxlarge") model = PeftModel.from_pretrained(base_model, "quasar529/cola-deberta_initialize_dW_B_with_svd_from_back_dW_A_zero")
