Barist.1 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
b30408a verified
|
Raw History Blame Contribute Delete
1.52 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.1988 0.71 0.07111111111111111 0.041884816753926704
textdetox_ar 800 0.0051 0.3 0.010471204188481674 0.0
textdetox_de 800 0.5753 0.5 0.5417721518987342 0.46153846153846156
textdetox_en 800 0.8104 0.5 0.8008849557522124 0.3613861386138614
textdetox_es 800 0.6354 0.5 0.6190476190476191 0.5867346938775511
textdetox_fr 800 0.5159 0.5 0.56047197640118 0.2315270935960591
textdetox_he 800 0.0293 0.38 0.03488372093023255 0.004310344827586207
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4723 0.75 0.14222222222222222 0.06829268292682927
textdetox_it 800 0.5795 0.5 0.5927710843373494 0.4489795918367347
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.4085 0.68 0.17475728155339806 0.04072398190045249
textdetox_tt 800 0.5473 0.5 0.5671641791044776 0.4105263157894737
textdetox_uk 800 0.3940 0.7 0.14611872146118723 0.05741626794258373
textdetox_zh 800 0.0191 0.3 0.02857142857142857 0.02030456852791878
synth_cs 300 1.0000 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”