Commit
·
838fc6d
1
Parent(s):
c993230
Update README.md
Browse files
README.md
CHANGED
|
@@ -152,13 +152,14 @@ Here are the train/dev/test splits of the datasets:
|
|
| 152 |
|
| 153 |
### Evaluation Results
|
| 154 |
|
| 155 |
-
| Task | NER (F1) | POS (F1) | STS (
|
| 156 |
-
| ------------|:-------------:|
|
| 157 |
-
| RoBERTa-base-ca-v2
|
| 158 |
-
| BERTa
|
| 159 |
-
| mBERT
|
| 160 |
-
| XLM-RoBERTa |
|
| 161 |
-
|
|
|
|
| 162 |
|
| 163 |
## Licensing Information
|
| 164 |
|
|
|
|
| 152 |
|
| 153 |
### Evaluation Results
|
| 154 |
|
| 155 |
+
| Task | NER (F1) | POS (F1) | STS (Combined) | TC (Accuracy) | TE (Accuracy) | QA (Vilaquad) (F1/EM)| QA (ViquiQuAD) (F1/EM) | QA (CatalanQA) (F1/EM) | QA (XQuAD-Ca)<sup>1</sup> (F1/EM) |
|
| 156 |
+
| ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
|
| 157 |
+
| RoBERTa-base-ca-v2 | **89.45** | 99.09 | 79.07 | **74.26** | **83.14** | **87.74/72.58** | **88.72/75.91** | **89.50**/76.63 | **73.64/55.42** |
|
| 158 |
+
| BERTa | 88.94 | **99.10** | **80.19** | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/**77.14** | 69.20/51.47 |
|
| 159 |
+
| mBERT | 87.36 | 98.98 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 | 68.79/50.80 |
|
| 160 |
+
| XLM-RoBERTa | 88.07 | 99.03 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 | 72.55/54.16 |
|
| 161 |
+
|
| 162 |
+
<sup>1</sup> : Trained on CatalanQA, tested on XQuAD-Ca.
|
| 163 |
|
| 164 |
## Licensing Information
|
| 165 |
|