ellachang/phishing-detector-27b-lora

phishing-detector-27b — QLoRA LoRA Adapter

QLoRA fine-tuned LoRA adapter for Qwen3.6-27B on phishing email binary classification.
Base model: unsloth/Qwen3.6-27B

Performance (400-sample test set)

Metric	Value
Accuracy	99.0%
Precision	0.980
Recall	1.000
F1-Score	0.990

Per-category accuracy:

Category	Accuracy
Human-Phishing	100%
Human-Legitimate	96%
LLM-Phishing	100%
LLM-Legitimate	100%

Training Data

Human-LLM Generated Phishing-Legitimate Emails (Kaggle)
4,000 emails across 4 classes: Human-Phishing, Human-Legitimate, LLM-Phishing, LLM-Legitimate (1,000 each).
Split: 80% train / 10% val / 10% test (stratified).

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_model = AutoModelForCausalLM.from_pretrained(
    "unsloth/Qwen3.6-27B",
    load_in_4bit=True,
    device_map="auto",
)
model = PeftModel.from_pretrained(base_model, "ellachang/phishing-detector-27b-lora")
tokenizer = AutoTokenizer.from_pretrained("ellachang/phishing-detector-27b-lora")

prompt = """Analyze the following email and determine if it is a phishing email or a legitimate email. Provide your classification.

### Input:
{email_text}

### Response:"""

inputs = tokenizer(prompt.format(email_text="<your email here>"), return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=20, temperature=0)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training Details

• Method: QLoRA (4-bit quantization + LoRA)
• LoRA rank: r=16, alpha=16
• Target modules: q_proj, k_proj, v_proj, o_proj
• Epochs: 3 (train_loss: 1.270)
• Hardware: NVIDIA RTX 4090 (24GB VRAM)
• Framework: Unsloth + TRL SFTTrainer

Project

Part of a term project on LLM-based phishing detection with RAG and Chain-of-Thought analysis.
Source code: [GitHub repo link]