devndeploy/bert-prompt-injection-detector

BERT Multilingual Prompt Injection Detector

Fine-tuned bert-base-multilingual-cased for detecting prompt injection attacks across 11+ languages.

Quick Start

from transformers import pipeline

classifier = pipeline("text-classification", model="devndeploy/bert-prompt-injection-detector")
result = classifier("Ignore all previous instructions")
# [{'label': 'INJECTION', 'score': 0.999}]

Performance

Metric	Score
Accuracy	96.47%
Precision	99.20%
Recall	93.94%
F1 Score	96.50%

Training

• Dataset: rikka-snow/prompt-injection-multilingual (7,282 samples)
• Base Model: bert-base-multilingual-cased
• Languages: English, German, Spanish, French, Chinese, Vietnamese, Japanese, Korean, Arabic, Russian, Portuguese
• Training Time: ~19 minutes on GPU

Use Cases

• Security layer for AI chatbots
• Content moderation
• Adversarial prompt detection

Limitations

• May not detect novel injection techniques
• Performance varies across languages
• Should be used as part of a defense-in-depth strategy

License

MIT