Barist.2 / reports /adversarial.md
KucLab's picture
Add report adversarial.md
59c45a4 verified
|
Raw History Blame Contribute Delete
374 Bytes

Adversarial robustness (unsafe items under text attacks)

n=160 unsafe items, threshold 0.5, detection rate = fraction still flagged unsafe.

Attack Detection rate Mean unsafe prob
clean 98.8% 0.850
typo 95.0% 0.794
leet 98.8% 0.846
homoglyph 99.4% 0.882
zero_width 100.0% 0.886
case 96.2% 0.792