How to use Rexe/Deci-Decicoder-1b-qlora-coder with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Deci/DeciCoder-1b") model = PeftModel.from_pretrained(base_model, "Rexe/Deci-Decicoder-1b-qlora-coder")
What is a pickle import?