Censer.9 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
c410e7b verified
|
Raw History Blame Contribute Delete
1.51 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.0665 0.46 0.08530805687203791 0.061611374407582936
textdetox_ar 800 0.0051 0.3 0.010309278350515464 0.0
textdetox_de 800 0.6056 0.92 0.038461538461538464 0.024875621890547265
textdetox_en 800 0.8108 0.79 0.7965616045845272 0.09523809523809523
textdetox_es 800 0.6436 0.5 0.6529774127310062 0.6086956521739131
textdetox_fr 800 0.5053 0.89 0.25 0.03773584905660377
textdetox_he 800 0.0294 0.38 0.03571428571428571 0.016736401673640166
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.5406 0.87 0.11504424778761062 0.03608247422680412
textdetox_it 800 0.5947 0.9 0.125 0.020618556701030927
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.1934 0.58 0.1739130434782609 0.030612244897959183
textdetox_tt 800 0.3942 0.9 0.09691629955947137 0.046632124352331605
textdetox_uk 800 0.2370 0.71 0.1965811965811966 0.045454545454545456
textdetox_zh 800 0.0097 0.3 0.017241379310344827 0.022988505747126436
synth_cs 300 1.0000 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”