gonzalez-agirre commited on
Commit
838fc6d
·
1 Parent(s): c993230

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -152,13 +152,14 @@ Here are the train/dev/test splits of the datasets:
152
 
153
  ### Evaluation Results
154
 
155
- | Task | NER (F1) | POS (F1) | STS (Pearson) | TC (accuracy) | QA (ViquiQuAD) (F1/EM) | QA (XQuAD) (F1/EM) |
156
- | ------------|:-------------:| -----:|:------|:-------|:------|:----|
157
- | RoBERTa-base-ca-v2 | **89.84** | **99.07** | **79.98** | **83.41** | **88.04/74.65** | **71.50/53.41** |
158
- | BERTa | 88.13 | 98.97 | 79.73 | 74.16 | 86.97/72.29 | 68.89/48.87 |
159
- | mBERT | 86.38 | 98.82 | 76.34 | 70.56 | 86.97/72.22 | 67.15/46.51 |
160
- | XLM-RoBERTa | 87.66 | 98.89 | 75.40 | 71.68 | 85.50/70.47 | 67.10/46.42 |
161
- | WikiBERT-ca | 77.66 | 97.60 | 77.18 | 73.22 | 85.45/70.75 | 65.21/36.60 |
 
162
 
163
  ## Licensing Information
164
 
 
152
 
153
  ### Evaluation Results
154
 
155
+ | Task | NER (F1) | POS (F1) | STS (Combined) | TC (Accuracy) | TE (Accuracy) | QA (Vilaquad) (F1/EM)| QA (ViquiQuAD) (F1/EM) | QA (CatalanQA) (F1/EM) | QA (XQuAD-Ca)<sup>1</sup> (F1/EM) |
156
+ | ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
157
+ | RoBERTa-base-ca-v2 | **89.45** | 99.09 | 79.07 | **74.26** | **83.14** | **87.74/72.58** | **88.72/75.91** | **89.50**/76.63 | **73.64/55.42** |
158
+ | BERTa | 88.94 | **99.10** | **80.19** | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/**77.14** | 69.20/51.47 |
159
+ | mBERT | 87.36 | 98.98 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 | 68.79/50.80 |
160
+ | XLM-RoBERTa | 88.07 | 99.03 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 | 72.55/54.16 |
161
+
162
+ <sup>1</sup> : Trained on CatalanQA, tested on XQuAD-Ca.
163
 
164
  ## Licensing Information
165