Update README.md
Browse files
README.md
CHANGED
|
@@ -105,7 +105,7 @@ This model is based upon a ensemble of RoBERTa models that was fine-tuned using
|
|
| 105 |
|
| 106 |
<!-- This should describe any evaluation data used (e.g., the development/validation set provided). -->
|
| 107 |
|
| 108 |
-
A subset of the development set provided, amounting to
|
| 109 |
|
| 110 |
#### Metrics
|
| 111 |
|
|
@@ -119,7 +119,29 @@ A subset of the development set provided, amounting to 6K+ pairs.
|
|
| 119 |
|
| 120 |
### Results
|
| 121 |
|
| 122 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 123 |
|
| 124 |
## Technical Specifications
|
| 125 |
|
|
|
|
| 105 |
|
| 106 |
<!-- This should describe any evaluation data used (e.g., the development/validation set provided). -->
|
| 107 |
|
| 108 |
+
A subset of the development set provided, amounting to 5.3k+ pairs for validation and 1.3k+ for testing.
|
| 109 |
|
| 110 |
#### Metrics
|
| 111 |
|
|
|
|
| 119 |
|
| 120 |
### Results
|
| 121 |
|
| 122 |
+
|
| 123 |
+
The Ensemble Model obtained an F1-score of 91% and an accuracy of 91%.
|
| 124 |
+
|
| 125 |
+
Validation set
|
| 126 |
+
- Macro Precision: 91.0%
|
| 127 |
+
- Macro Recall: 91.0%
|
| 128 |
+
- Macro F1-score: 91.0%
|
| 129 |
+
- Weighted Precision: 91.0%
|
| 130 |
+
- Weighted Recall: 91.0%
|
| 131 |
+
- Weighted F1-score: 91.0%
|
| 132 |
+
- accuracy: 91.0%
|
| 133 |
+
- Support: 5389
|
| 134 |
+
|
| 135 |
+
Test set
|
| 136 |
+
- Macro Precision: 91.0%
|
| 137 |
+
- Macro Recall: 91.0%
|
| 138 |
+
- Macro F1-score: 91.0%
|
| 139 |
+
- Weighted Precision: 91.0%
|
| 140 |
+
- Weighted Recall: 91.0%
|
| 141 |
+
- Weighted F1-score: 91.0%
|
| 142 |
+
- accuracy: 91.0%
|
| 143 |
+
- Support: 1347
|
| 144 |
+
|
| 145 |
|
| 146 |
## Technical Specifications
|
| 147 |
|