Barist.5 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
b20df39 verified
|
Raw History Blame Contribute Delete
1.51 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.4336 0.74 0.09216589861751152 0.05853658536585366
textdetox_ar 800 0.0052 0.3 0.010582010582010583 0.0
textdetox_de 800 0.5228 0.5 0.5217391304347826 0.3786407766990291
textdetox_en 800 0.8121 0.5 0.8192219679633868 0.3073170731707317
textdetox_es 800 0.6044 0.5 0.5958429561200924 0.5
textdetox_fr 800 0.4643 0.69 0.28333333333333327 0.05825242718446602
textdetox_he 800 0.0351 0.3 0.0782122905027933 0.012987012987012988
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4188 0.74 0.12444444444444444 0.05025125628140704
textdetox_it 800 0.5396 0.5 0.5506493506493506 0.38578680203045684
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.5280 0.65 0.11707317073170731 0.037209302325581395
textdetox_tt 800 0.5606 0.72 0.15517241379310345 0.046153846153846156
textdetox_uk 800 0.4744 0.63 0.23868312757201646 0.09268292682926829
textdetox_zh 800 0.0286 0.3 0.07272727272727274 0.04568527918781726
synth_cs 300 0.9831 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”