Create README.md

README.md

@@ -0,0 +1,24 @@
+Based on svenbl80/deberta-v3-Base-finetuned-mnli finetuned on a synthetic dataset (3 labels, real-estate + berechtigungsmanagement)
+
+Performance on test dataset:
+
+              precision    recall  f1-score   support
+
+           0       1.00      0.93      0.96        42
+           1       0.94      0.97      0.95        76
+           2       0.98      0.98      0.98       114
+
+    accuracy                           0.97       232
+    macro avg       0.97      0.96      0.97       232
+    weighted avg       0.97      0.97      0.97       232
+
+Performance on real estate test dataset alone:
+              precision    recall  f1-score   support
+
+           0       1.00      0.83      0.91        18
+           1       0.73      1.00      0.85        11
+           2       1.00      0.94      0.97        16
+
+    accuracy                           0.91        45
+    macro avg       0.91      0.92      0.91        45
+    weighted avg       0.93      0.91      0.91        45