predict_llama3_8b / README.md
yonad2008's picture
Upload README.md with huggingface_hub
6b6b19c verified
metadata
language: en
tags:
  - jailbreak-detection
  - deberta-v3
  - text-classification
model-index:
  - name: predict_llama3_8b
    results:
      - task:
          type: text-classification
          name: Jailbreak Detection
        metrics:
          - name: F1
            type: f1
            value: 0.8429
          - name: PR-AUC
            type: pr_auc
            value: 0.9213
          - name: ROC-AUC
            type: roc_auc
            value: 0.9714
          - name: Precision
            type: precision
            value: 0.8429
          - name: Recall
            type: recall
            value: 0.8429

Jailbreak Prediction Model: llama3:8b

Fine-tuned DeBERTa-v3-base for detecting unsafe/jailbreak prompts in multi-turn conversations.

Evaluation Results (best fold: 3)

Metric Value
F1 0.8429
PR-AUC 0.9213
ROC-AUC 0.9714
Precision 0.8429
Recall 0.8429
Best Threshold 0.10

Training Details

  • Base model: microsoft/deberta-v3-base
  • Target model: llama3:8b
  • Datasets: HarmBench
  • K-Folds: 5
  • Epochs: 5
  • Learning Rate: 2e-05
  • Max Length: 512
  • Input format: turns only

Dataset Size (before turn expansion)

Original rows (after cleaning and balancing): 1910 (unsafe: 345, safe: 1565)