Barist.4 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
65a104b verified
|
Raw History Blame Contribute Delete
1.52 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.3577 0.73 0.12903225806451613 0.07075471698113207
textdetox_ar 800 0.0052 0.3 0.00970873786407767 0.00510204081632653
textdetox_de 800 0.5575 0.5 0.558139534883721 0.4238095238095238
textdetox_en 800 0.8131 0.5 0.8143176733780761 0.3382352941176471
textdetox_es 800 0.6156 0.5 0.6469248291571753 0.47715736040609136
textdetox_fr 800 0.4856 0.74 0.2845849802371541 0.031746031746031744
textdetox_he 800 0.0293 0.3 0.06857142857142856 0.01702127659574468
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4367 0.7 0.16806722689075632 0.08080808080808081
textdetox_it 800 0.5660 0.5 0.5378590078328981 0.4088669950738916
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.6156 0.69 0.14746543778801843 0.05687203791469194
textdetox_tt 800 0.6080 0.75 0.11607142857142858 0.05970149253731343
textdetox_uk 800 0.5526 0.7 0.20535714285714285 0.03864734299516908
textdetox_zh 800 0.0333 0.3 0.08411214953271028 0.025
synth_cs 300 0.9899 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”