Josef0801/model_deberta_6_labels

Based on microsoft/deberta-v3-base, finetuned on a synthetic dataset (6 labels).

Performance on test dataset:

          precision    recall  f1-score   support

       0       0.56      0.73      0.63        26
       1       0.70      1.00      0.82        28
       2       0.68      0.53      0.60        32
       3       0.97      1.00      0.99        33
       4       1.00      0.97      0.98        33
       5       0.52      0.33      0.41        36

accuracy                           0.75       188

macro avg 0.74 0.76 0.74 188 weighted avg 0.74 0.75 0.74 188

Performance on similar benchmark:

         precision    recall  f1-score   support

       0       0.22      0.83      0.34        23
       1       0.50      0.01      0.03        75
       2       0.19      0.26      0.22        19

accuracy                           0.21       117

macro avg 0.30 0.37 0.20 117 weighted avg 0.39 0.21 0.12 117