KucLab commited on
Commit
b366c3a
·
verified ·
1 Parent(s): a5d13e2

Add report adversarial.md

Browse files
Files changed (1) hide show
  1. reports/adversarial.md +12 -0
reports/adversarial.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Adversarial robustness (unsafe items under text attacks)
2
+
3
+ n=160 unsafe items, threshold 0.5, detection rate = fraction still flagged unsafe.
4
+
5
+ | Attack | Detection rate | Mean unsafe prob |
6
+ | --- | --- | --- |
7
+ | clean | 98.8% | 0.848 |
8
+ | typo | 96.2% | 0.798 |
9
+ | leet | 98.1% | 0.844 |
10
+ | homoglyph | 99.4% | 0.866 |
11
+ | zero_width | 100.0% | 0.879 |
12
+ | case | 97.5% | 0.794 |