KucLab commited on
Commit
be7965c
Β·
verified Β·
1 Parent(s): 00a7821

Add report multilingual.md

Browse files
Files changed (1) hide show
  1. reports/multilingual.md +23 -0
reports/multilingual.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)
2
+
3
+ | set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
4
+ | --- | --- | --- | --- | --- | --- |
5
+ | textdetox_am | 800 | 0.1086 | 0.66 | 0.06965174129353234 | 0.046296296296296294 |
6
+ | textdetox_ar | 800 | 0.0052 | 0.3 | 0.00975609756097561 | 0.005076142131979695 |
7
+ | textdetox_de | 800 | 0.5217 | 0.5 | 0.5 | 0.39195979899497485 |
8
+ | textdetox_en | 800 | 0.8136 | 0.5 | 0.7911111111111112 | 0.3786407766990291 |
9
+ | textdetox_es | 800 | 0.6120 | 0.5 | 0.6606334841628959 | 0.43478260869565216 |
10
+ | textdetox_fr | 800 | 0.4631 | 0.5 | 0.5222929936305731 | 0.16417910447761194 |
11
+ | textdetox_he | 800 | 0.0236 | 0.3 | 0.03614457831325301 | 0.008368200836820083 |
12
+ | textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
13
+ | textdetox_hin | 800 | 0.4456 | 0.5 | 0.47284345047923326 | 0.17857142857142858 |
14
+ | textdetox_it | 800 | 0.5548 | 0.5 | 0.5415549597855227 | 0.350253807106599 |
15
+ | textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
16
+ | textdetox_ru | 800 | 0.0397 | 0.3 | 0.08928571428571427 | 0.015873015873015872 |
17
+ | textdetox_tt | 800 | 0.1161 | 0.62 | 0.1272727272727273 | 0.03 |
18
+ | textdetox_uk | 800 | 0.0447 | 0.3 | 0.10945273631840796 | 0.018691588785046728 |
19
+ | textdetox_zh | 800 | 0.0000 | 0.32 | 0.019417475728155338 | 0.01507537688442211 |
20
+ | synth_cs | 300 | 0.9967 | β€” | β€” | β€” |
21
+ | synth_de | 300 | 1.0000 | β€” | β€” | β€” |
22
+ | synth_es | 300 | 1.0000 | β€” | β€” | β€” |
23
+ | synth_fr | 300 | 1.0000 | β€” | β€” | β€” |