KucLab commited on
Commit
9317479
·
verified ·
1 Parent(s): 4d7d05b

Add report adversarial.md

Browse files
Files changed (1) hide show
  1. reports/adversarial.md +12 -0
reports/adversarial.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Adversarial robustness (unsafe items under text attacks)
2
+
3
+ n=160 unsafe items, threshold 0.5, detection rate = fraction still flagged unsafe.
4
+
5
+ | Attack | Detection rate | Mean unsafe prob |
6
+ | --- | --- | --- |
7
+ | clean | 98.8% | 0.847 |
8
+ | typo | 96.2% | 0.799 |
9
+ | leet | 98.8% | 0.845 |
10
+ | homoglyph | 99.4% | 0.865 |
11
+ | zero_width | 100.0% | 0.880 |
12
+ | case | 97.5% | 0.794 |