Barist.2 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
cdf33b8 verified
|
Raw History Blame Contribute Delete
1.5 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.1777 0.65 0.09865470852017938 0.06467661691542288
textdetox_ar 800 0.0051 0.3 0.0 0.0
textdetox_de 800 0.5869 0.5 0.6009615384615384 0.47342995169082125
textdetox_en 800 0.8126 0.5 0.8282352941176471 0.27403846153846156
textdetox_es 800 0.6332 0.5 0.6307053941908715 0.631578947368421
textdetox_fr 800 0.5213 0.71 0.3397683397683398 0.0975609756097561
textdetox_he 800 0.0293 0.3 0.055865921787709494 0.008771929824561403
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4769 0.73 0.17543859649122806 0.06341463414634146
textdetox_it 800 0.5784 0.5 0.583756345177665 0.41545893719806765
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.3953 0.63 0.19913419913419914 0.06796116504854369
textdetox_tt 800 0.5114 0.5 0.5080213903743316 0.38578680203045684
textdetox_uk 800 0.3772 0.64 0.1981981981981982 0.06103286384976526
textdetox_zh 800 0.0191 0.3 0.06572769953051644 0.020202020202020204
synth_cs 300 1.0000 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”