How to use arhamk/llama2-qlora-sft with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TinyPixel/Llama-2-7B-bf16-sharded") model = PeftModel.from_pretrained(base_model, "arhamk/llama2-qlora-sft")
How to use arhamk/llama2-qlora-sft with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arhamk/llama2-qlora-sft", dtype="auto")
What is a pickle import?
