KucLab commited on
Commit
bcfd5fd
·
verified ·
1 Parent(s): ed5b6f0

Add report adversarial.md

Browse files
Files changed (1) hide show
  1. reports/adversarial.md +12 -0
reports/adversarial.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Adversarial robustness (unsafe items under text attacks)
2
+
3
+ n=160 unsafe items, threshold 0.5, detection rate = fraction still flagged unsafe.
4
+
5
+ | Attack | Detection rate | Mean unsafe prob |
6
+ | --- | --- | --- |
7
+ | clean | 99.4% | 0.917 |
8
+ | typo | 94.4% | 0.858 |
9
+ | leet | 97.5% | 0.906 |
10
+ | homoglyph | 100.0% | 0.947 |
11
+ | zero_width | 100.0% | 0.939 |
12
+ | case | 95.6% | 0.833 |