Create README.md

README.md

@@ -0,0 +1,30 @@
+Based on microsoft/deberta-v3-base, finetuned on a synthetic dataset (6 labels were converted to 3 labels).
+
+Performance on test dataset:
+              precision    recall  f1-score   support
+
+           0       0.98      0.99      0.98        94
+           1       0.96      0.96      0.96        28
+           2       1.00      0.98      0.99        66
+
+    accuracy                           0.98       188
+    
+   macro avg       0.98      0.98      0.98       188
+   
+weighted avg       0.98      0.98      0.98       188
+
+
+Performance on similar benchmark:
+             precision    recall  f1-score   support
+
+           0       0.13      0.52      0.21        23
+           1       0.44      0.15      0.22        75
+           2       0.00      0.00      0.00        19
+
+    accuracy                           0.20       117
+    
+   macro avg       0.19      0.22      0.14       117
+   
+weighted avg       0.31      0.20      0.18       117
+
+