How to use hash-map/got_QA_fine_tuned_model with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-2b-it") model = PeftModel.from_pretrained(base_model, "hash-map/got_QA_fine_tuned_model")
How to use hash-map/got_QA_fine_tuned_model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="hash-map/got_QA_fine_tuned_model")
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("hash-map/got_QA_fine_tuned_model", dtype="auto")
What is a pickle import?
How to fix it?
