File size: 1,070 Bytes
bfa57c3 25c6fe3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |
Based on microsoft/deberta-v3-base, finetuned on a synthetic dataset (6 labels).
Performance on test dataset:
precision recall f1-score support
0 0.56 0.73 0.63 26
1 0.70 1.00 0.82 28
2 0.68 0.53 0.60 32
3 0.97 1.00 0.99 33
4 1.00 0.97 0.98 33
5 0.52 0.33 0.41 36
accuracy 0.75 188
macro avg 0.74 0.76 0.74 188
weighted avg 0.74 0.75 0.74 188
Performance on similar benchmark:
precision recall f1-score support
0 0.22 0.83 0.34 23
1 0.50 0.01 0.03 75
2 0.19 0.26 0.22 19
accuracy 0.21 117
macro avg 0.30 0.37 0.20 117
weighted avg 0.39 0.21 0.12 117 |