KucLab commited on
Commit
c410e7b
Β·
verified Β·
1 Parent(s): e2f55be

Add report multilingual.md

Browse files
Files changed (1) hide show
  1. reports/multilingual.md +23 -0
reports/multilingual.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)
2
+
3
+ | set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
4
+ | --- | --- | --- | --- | --- | --- |
5
+ | textdetox_am | 800 | 0.0665 | 0.46 | 0.08530805687203791 | 0.061611374407582936 |
6
+ | textdetox_ar | 800 | 0.0051 | 0.3 | 0.010309278350515464 | 0.0 |
7
+ | textdetox_de | 800 | 0.6056 | 0.92 | 0.038461538461538464 | 0.024875621890547265 |
8
+ | textdetox_en | 800 | 0.8108 | 0.79 | 0.7965616045845272 | 0.09523809523809523 |
9
+ | textdetox_es | 800 | 0.6436 | 0.5 | 0.6529774127310062 | 0.6086956521739131 |
10
+ | textdetox_fr | 800 | 0.5053 | 0.89 | 0.25 | 0.03773584905660377 |
11
+ | textdetox_he | 800 | 0.0294 | 0.38 | 0.03571428571428571 | 0.016736401673640166 |
12
+ | textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
13
+ | textdetox_hin | 800 | 0.5406 | 0.87 | 0.11504424778761062 | 0.03608247422680412 |
14
+ | textdetox_it | 800 | 0.5947 | 0.9 | 0.125 | 0.020618556701030927 |
15
+ | textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
16
+ | textdetox_ru | 800 | 0.1934 | 0.58 | 0.1739130434782609 | 0.030612244897959183 |
17
+ | textdetox_tt | 800 | 0.3942 | 0.9 | 0.09691629955947137 | 0.046632124352331605 |
18
+ | textdetox_uk | 800 | 0.2370 | 0.71 | 0.1965811965811966 | 0.045454545454545456 |
19
+ | textdetox_zh | 800 | 0.0097 | 0.3 | 0.017241379310344827 | 0.022988505747126436 |
20
+ | synth_cs | 300 | 1.0000 | β€” | β€” | β€” |
21
+ | synth_de | 300 | 1.0000 | β€” | β€” | β€” |
22
+ | synth_es | 300 | 1.0000 | β€” | β€” | β€” |
23
+ | synth_fr | 300 | 1.0000 | β€” | β€” | β€” |