KucLab commited on
Commit
b414e29
Β·
verified Β·
1 Parent(s): e20cdd2

Add report multilingual.md

Browse files
Files changed (1) hide show
  1. reports/multilingual.md +23 -0
reports/multilingual.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)
2
+
3
+ | set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
4
+ | --- | --- | --- | --- | --- | --- |
5
+ | textdetox_am | 800 | 0.4680 | 0.5 | 0.49489795918367346 | 0.475 |
6
+ | textdetox_ar | 800 | 0.0052 | 0.39 | 0.0 | 0.0 |
7
+ | textdetox_de | 800 | 0.5696 | 0.5 | 0.5532994923857868 | 0.4362745098039216 |
8
+ | textdetox_en | 800 | 0.8098 | 0.5 | 0.8286334056399132 | 0.336734693877551 |
9
+ | textdetox_es | 800 | 0.6161 | 0.5 | 0.631336405529954 | 0.48756218905472637 |
10
+ | textdetox_fr | 800 | 0.4984 | 0.71 | 0.2796610169491525 | 0.05741626794258373 |
11
+ | textdetox_he | 800 | 0.0349 | 0.3 | 0.1368421052631579 | 0.01762114537444934 |
12
+ | textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
13
+ | textdetox_hin | 800 | 0.4412 | 0.74 | 0.11555555555555556 | 0.04568527918781726 |
14
+ | textdetox_it | 800 | 0.5589 | 0.74 | 0.20408163265306123 | 0.08163265306122448 |
15
+ | textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
16
+ | textdetox_ru | 800 | 0.5731 | 0.62 | 0.24505928853754938 | 0.11 |
17
+ | textdetox_tt | 800 | 0.5711 | 0.74 | 0.12556053811659193 | 0.010362694300518135 |
18
+ | textdetox_uk | 800 | 0.4888 | 0.66 | 0.12280701754385966 | 0.041237113402061855 |
19
+ | textdetox_zh | 800 | 0.0286 | 0.3 | 0.06542056074766356 | 0.03015075376884422 |
20
+ | synth_cs | 300 | 0.9933 | β€” | β€” | β€” |
21
+ | synth_de | 300 | 1.0000 | β€” | β€” | β€” |
22
+ | synth_es | 300 | 1.0000 | β€” | β€” | β€” |
23
+ | synth_fr | 300 | 1.0000 | β€” | β€” | β€” |