KucLab commited on
Commit
cdf33b8
Β·
verified Β·
1 Parent(s): 01a1cb3

Add report multilingual.md

Browse files
Files changed (1) hide show
  1. reports/multilingual.md +23 -0
reports/multilingual.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)
2
+
3
+ | set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
4
+ | --- | --- | --- | --- | --- | --- |
5
+ | textdetox_am | 800 | 0.1777 | 0.65 | 0.09865470852017938 | 0.06467661691542288 |
6
+ | textdetox_ar | 800 | 0.0051 | 0.3 | 0.0 | 0.0 |
7
+ | textdetox_de | 800 | 0.5869 | 0.5 | 0.6009615384615384 | 0.47342995169082125 |
8
+ | textdetox_en | 800 | 0.8126 | 0.5 | 0.8282352941176471 | 0.27403846153846156 |
9
+ | textdetox_es | 800 | 0.6332 | 0.5 | 0.6307053941908715 | 0.631578947368421 |
10
+ | textdetox_fr | 800 | 0.5213 | 0.71 | 0.3397683397683398 | 0.0975609756097561 |
11
+ | textdetox_he | 800 | 0.0293 | 0.3 | 0.055865921787709494 | 0.008771929824561403 |
12
+ | textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
13
+ | textdetox_hin | 800 | 0.4769 | 0.73 | 0.17543859649122806 | 0.06341463414634146 |
14
+ | textdetox_it | 800 | 0.5784 | 0.5 | 0.583756345177665 | 0.41545893719806765 |
15
+ | textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
16
+ | textdetox_ru | 800 | 0.3953 | 0.63 | 0.19913419913419914 | 0.06796116504854369 |
17
+ | textdetox_tt | 800 | 0.5114 | 0.5 | 0.5080213903743316 | 0.38578680203045684 |
18
+ | textdetox_uk | 800 | 0.3772 | 0.64 | 0.1981981981981982 | 0.06103286384976526 |
19
+ | textdetox_zh | 800 | 0.0191 | 0.3 | 0.06572769953051644 | 0.020202020202020204 |
20
+ | synth_cs | 300 | 1.0000 | β€” | β€” | β€” |
21
+ | synth_de | 300 | 1.0000 | β€” | β€” | β€” |
22
+ | synth_es | 300 | 1.0000 | β€” | β€” | β€” |
23
+ | synth_fr | 300 | 1.0000 | β€” | β€” | β€” |