Barist.7 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
b414e29 verified
|
Raw History Blame Contribute Delete
1.48 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.4680 0.5 0.49489795918367346 0.475
textdetox_ar 800 0.0052 0.39 0.0 0.0
textdetox_de 800 0.5696 0.5 0.5532994923857868 0.4362745098039216
textdetox_en 800 0.8098 0.5 0.8286334056399132 0.336734693877551
textdetox_es 800 0.6161 0.5 0.631336405529954 0.48756218905472637
textdetox_fr 800 0.4984 0.71 0.2796610169491525 0.05741626794258373
textdetox_he 800 0.0349 0.3 0.1368421052631579 0.01762114537444934
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4412 0.74 0.11555555555555556 0.04568527918781726
textdetox_it 800 0.5589 0.74 0.20408163265306123 0.08163265306122448
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.5731 0.62 0.24505928853754938 0.11
textdetox_tt 800 0.5711 0.74 0.12556053811659193 0.010362694300518135
textdetox_uk 800 0.4888 0.66 0.12280701754385966 0.041237113402061855
textdetox_zh 800 0.0286 0.3 0.06542056074766356 0.03015075376884422
synth_cs 300 0.9933 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”