Barist.6 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
950f9c9 verified
|
Raw History Blame Contribute Delete
1.49 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.4568 0.74 0.07476635514018691 0.05365853658536585
textdetox_ar 800 0.0052 0.3 0.020833333333333332 0.0
textdetox_de 800 0.5501 0.5 0.5376344086021505 0.375609756097561
textdetox_en 800 0.8112 0.5 0.8290398126463701 0.2857142857142857
textdetox_es 800 0.6133 0.5 0.6178489702517163 0.48148148148148145
textdetox_fr 800 0.4857 0.7 0.256198347107438 0.055
textdetox_he 800 0.0349 0.3 0.10989010989010989 0.017241379310344827
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4283 0.69 0.2184873949579832 0.08737864077669903
textdetox_it 800 0.5529 0.5 0.5135135135135136 0.4019138755980861
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.5408 0.65 0.168141592920354 0.035
textdetox_tt 800 0.5603 0.71 0.1461187214611872 0.06190476190476191
textdetox_uk 800 0.4769 0.64 0.15720524017467247 0.05970149253731343
textdetox_zh 800 0.0286 0.3 0.11255411255411255 0.037037037037037035
synth_cs 300 0.9865 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”