KucLab commited on
Commit
b20df39
Β·
verified Β·
1 Parent(s): 11b2eec

Add report multilingual.md

Browse files
Files changed (1) hide show
  1. reports/multilingual.md +23 -0
reports/multilingual.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)
2
+
3
+ | set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
4
+ | --- | --- | --- | --- | --- | --- |
5
+ | textdetox_am | 800 | 0.4336 | 0.74 | 0.09216589861751152 | 0.05853658536585366 |
6
+ | textdetox_ar | 800 | 0.0052 | 0.3 | 0.010582010582010583 | 0.0 |
7
+ | textdetox_de | 800 | 0.5228 | 0.5 | 0.5217391304347826 | 0.3786407766990291 |
8
+ | textdetox_en | 800 | 0.8121 | 0.5 | 0.8192219679633868 | 0.3073170731707317 |
9
+ | textdetox_es | 800 | 0.6044 | 0.5 | 0.5958429561200924 | 0.5 |
10
+ | textdetox_fr | 800 | 0.4643 | 0.69 | 0.28333333333333327 | 0.05825242718446602 |
11
+ | textdetox_he | 800 | 0.0351 | 0.3 | 0.0782122905027933 | 0.012987012987012988 |
12
+ | textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
13
+ | textdetox_hin | 800 | 0.4188 | 0.74 | 0.12444444444444444 | 0.05025125628140704 |
14
+ | textdetox_it | 800 | 0.5396 | 0.5 | 0.5506493506493506 | 0.38578680203045684 |
15
+ | textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
16
+ | textdetox_ru | 800 | 0.5280 | 0.65 | 0.11707317073170731 | 0.037209302325581395 |
17
+ | textdetox_tt | 800 | 0.5606 | 0.72 | 0.15517241379310345 | 0.046153846153846156 |
18
+ | textdetox_uk | 800 | 0.4744 | 0.63 | 0.23868312757201646 | 0.09268292682926829 |
19
+ | textdetox_zh | 800 | 0.0286 | 0.3 | 0.07272727272727274 | 0.04568527918781726 |
20
+ | synth_cs | 300 | 0.9831 | β€” | β€” | β€” |
21
+ | synth_de | 300 | 1.0000 | β€” | β€” | β€” |
22
+ | synth_es | 300 | 1.0000 | β€” | β€” | β€” |
23
+ | synth_fr | 300 | 1.0000 | β€” | β€” | β€” |