KucLab commited on
Commit
950f9c9
Β·
verified Β·
1 Parent(s): 3c175c2

Add report multilingual.md

Browse files
Files changed (1) hide show
  1. reports/multilingual.md +23 -0
reports/multilingual.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)
2
+
3
+ | set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
4
+ | --- | --- | --- | --- | --- | --- |
5
+ | textdetox_am | 800 | 0.4568 | 0.74 | 0.07476635514018691 | 0.05365853658536585 |
6
+ | textdetox_ar | 800 | 0.0052 | 0.3 | 0.020833333333333332 | 0.0 |
7
+ | textdetox_de | 800 | 0.5501 | 0.5 | 0.5376344086021505 | 0.375609756097561 |
8
+ | textdetox_en | 800 | 0.8112 | 0.5 | 0.8290398126463701 | 0.2857142857142857 |
9
+ | textdetox_es | 800 | 0.6133 | 0.5 | 0.6178489702517163 | 0.48148148148148145 |
10
+ | textdetox_fr | 800 | 0.4857 | 0.7 | 0.256198347107438 | 0.055 |
11
+ | textdetox_he | 800 | 0.0349 | 0.3 | 0.10989010989010989 | 0.017241379310344827 |
12
+ | textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
13
+ | textdetox_hin | 800 | 0.4283 | 0.69 | 0.2184873949579832 | 0.08737864077669903 |
14
+ | textdetox_it | 800 | 0.5529 | 0.5 | 0.5135135135135136 | 0.4019138755980861 |
15
+ | textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
16
+ | textdetox_ru | 800 | 0.5408 | 0.65 | 0.168141592920354 | 0.035 |
17
+ | textdetox_tt | 800 | 0.5603 | 0.71 | 0.1461187214611872 | 0.06190476190476191 |
18
+ | textdetox_uk | 800 | 0.4769 | 0.64 | 0.15720524017467247 | 0.05970149253731343 |
19
+ | textdetox_zh | 800 | 0.0286 | 0.3 | 0.11255411255411255 | 0.037037037037037035 |
20
+ | synth_cs | 300 | 0.9865 | β€” | β€” | β€” |
21
+ | synth_de | 300 | 1.0000 | β€” | β€” | β€” |
22
+ | synth_es | 300 | 1.0000 | β€” | β€” | β€” |
23
+ | synth_fr | 300 | 1.0000 | β€” | β€” | β€” |