Barist.2 / reports /adversarial.md
KucLab's picture
Add report adversarial.md
59c45a4 verified
|
Raw History Blame Contribute Delete
374 Bytes
# Adversarial robustness (unsafe items under text attacks)
n=160 unsafe items, threshold 0.5, detection rate = fraction still flagged unsafe.
| Attack | Detection rate | Mean unsafe prob |
| --- | --- | --- |
| clean | 98.8% | 0.850 |
| typo | 95.0% | 0.794 |
| leet | 98.8% | 0.846 |
| homoglyph | 99.4% | 0.882 |
| zero_width | 100.0% | 0.886 |
| case | 96.2% | 0.792 |