File size: 1,517 Bytes
be7965c
 
 
 
b30408a
 
 
 
 
 
 
be7965c
b30408a
 
be7965c
b30408a
 
 
 
4b5d3ba
be7965c
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
# Multilingual eval (textdetox: thr tuned on tune half, F1/FPR on untouched test half)

| set | n | F1@0.5 | tuned thr | test F1@thr | test FPR@thr |
| --- | --- | --- | --- | --- | --- |
| textdetox_am | 800 | 0.1988 | 0.71 | 0.07111111111111111 | 0.041884816753926704 |
| textdetox_ar | 800 | 0.0051 | 0.3 | 0.010471204188481674 | 0.0 |
| textdetox_de | 800 | 0.5753 | 0.5 | 0.5417721518987342 | 0.46153846153846156 |
| textdetox_en | 800 | 0.8104 | 0.5 | 0.8008849557522124 | 0.3613861386138614 |
| textdetox_es | 800 | 0.6354 | 0.5 | 0.6190476190476191 | 0.5867346938775511 |
| textdetox_fr | 800 | 0.5159 | 0.5 | 0.56047197640118 | 0.2315270935960591 |
| textdetox_he | 800 | 0.0293 | 0.38 | 0.03488372093023255 | 0.004310344827586207 |
| textdetox_hi | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
| textdetox_hin | 800 | 0.4723 | 0.75 | 0.14222222222222222 | 0.06829268292682927 |
| textdetox_it | 800 | 0.5795 | 0.5 | 0.5927710843373494 | 0.4489795918367347 |
| textdetox_ja | 800 | 0.0000 | 0.3 | 0.0 | 0.0 |
| textdetox_ru | 800 | 0.4085 | 0.68 | 0.17475728155339806 | 0.04072398190045249 |
| textdetox_tt | 800 | 0.5473 | 0.5 | 0.5671641791044776 | 0.4105263157894737 |
| textdetox_uk | 800 | 0.3940 | 0.7 | 0.14611872146118723 | 0.05741626794258373 |
| textdetox_zh | 800 | 0.0191 | 0.3 | 0.02857142857142857 | 0.02030456852791878 |
| synth_cs | 300 | 1.0000 | β€” | β€” | β€” |
| synth_de | 300 | 1.0000 | β€” | β€” | β€” |
| synth_es | 300 | 1.0000 | β€” | β€” | β€” |
| synth_fr | 300 | 1.0000 | β€” | β€” | β€” |