KucLab commited on
Commit
59c45a4
·
verified ·
1 Parent(s): 12ffde8

Add report adversarial.md

Browse files
Files changed (1) hide show
  1. reports/adversarial.md +12 -0
reports/adversarial.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Adversarial robustness (unsafe items under text attacks)
2
+
3
+ n=160 unsafe items, threshold 0.5, detection rate = fraction still flagged unsafe.
4
+
5
+ | Attack | Detection rate | Mean unsafe prob |
6
+ | --- | --- | --- |
7
+ | clean | 98.8% | 0.850 |
8
+ | typo | 95.0% | 0.794 |
9
+ | leet | 98.8% | 0.846 |
10
+ | homoglyph | 99.4% | 0.882 |
11
+ | zero_width | 100.0% | 0.886 |
12
+ | case | 96.2% | 0.792 |