rhyliieee/notes-completion-set
Viewer • Updated • 11.6k • 5
How to use rhyliieee/LLaMA3-8Bit-LoRA-Med-v2 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("aaditya/Llama3-OpenBioLLM-8B")
model = PeftModel.from_pretrained(base_model, "rhyliieee/LLaMA3-8Bit-LoRA-Med-v2")Base model
meta-llama/Meta-Llama-3-8B