Barist.3 / reports /multilingual.md
KucLab's picture
Add report multilingual.md
f5c5143 verified
|
Raw History Blame Contribute Delete
1.52 kB

Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

set n F1@0.5 tuned thr test F1@thr test FPR@thr
textdetox_am 800 0.2974 0.74 0.031088082901554407 0.023255813953488372
textdetox_ar 800 0.0052 0.3 0.009852216748768473 0.0
textdetox_de 800 0.5590 0.5 0.5863874345549738 0.36585365853658536
textdetox_en 800 0.8126 0.5 0.8243243243243243 0.3118811881188119
textdetox_es 800 0.6183 0.5 0.6355555555555555 0.5396039603960396
textdetox_fr 800 0.4912 0.74 0.27848101265822783 0.0392156862745098
textdetox_he 800 0.0293 0.3 0.06451612903225806 0.017857142857142856
textdetox_hi 800 0.0000 0.3 0.0 0.0
textdetox_hin 800 0.4521 0.73 0.17094017094017094 0.06532663316582915
textdetox_it 800 0.5722 0.5 0.5664160401002506 0.41237113402061853
textdetox_ja 800 0.0000 0.3 0.0 0.0
textdetox_ru 800 0.5735 0.68 0.14611872146118723 0.05741626794258373
textdetox_tt 800 0.5819 0.5 0.5841121495327103 0.5336538461538461
textdetox_uk 800 0.5128 0.7 0.16666666666666666 0.031818181818181815
textdetox_zh 800 0.0285 0.3 0.07860262008733625 0.03225806451612903
synth_cs 300 0.9933 β€” β€” β€”
synth_de 300 1.0000 β€” β€” β€”
synth_es 300 1.0000 β€” β€” β€”
synth_fr 300 1.0000 β€” β€” β€”