mlabonne/harmful_behaviors
Viewer • Updated • 520 • 12.4k • 125
How to use reissbaker/behemoth-1.2-distill with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B-Instruct")
model = PeftModel.from_pretrained(base_model, "reissbaker/behemoth-1.2-distill")This LoRA adapter was extracted from TheDrummer/Behemoth-123B-v1.2 and uses meta-llama/Llama-3.1-70B-Instruct as a base.
Base model
meta-llama/Llama-3.1-70B