How to use devrunner09/llama2-law-qa-26k-v1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/workdir/llama2-fine-tune/base_model/models--bkai-foundation-models--vietnamese-llama2-7b-40GB/snapshots/e6fa066ef3bbaaab292123fd313f67af25c944d4") model = PeftModel.from_pretrained(base_model, "devrunner09/llama2-law-qa-26k-v1")
The community tab is the place to discuss and collaborate with the HF community!
