How to use hurtmongoose/tinyllama-lora-malicious-classifier with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("TinyLlama/TinyLlama_v1.1") model = PeftModel.from_pretrained(base_model, "hurtmongoose/tinyllama-lora-malicious-classifier")
How to use hurtmongoose/tinyllama-lora-malicious-classifier with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("hurtmongoose/tinyllama-lora-malicious-classifier", dtype="auto")
How to fix it?
