mapama247 commited on
Commit
80c0538
·
1 Parent(s): 15b1de2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -6
README.md CHANGED
@@ -120,18 +120,19 @@ This model has been fine-tuned on the downstream tasks of the [Catalan Language
120
  | STS-ca | STS | 3,073 | 2,073 | 500 | 500 |
121
  | TeCla | TC | 137,775 | 110,203| 13,786| 13,786|
122
  | TE-ca | TE | 21,163 | 16,930 | 2,116 | 2,117 |
123
- | VilaQuAD | QA | 6,282 | 3,882 | 1,200 | 1,200 |
124
- | ViquiQuAD | QA | 14,239 | 11,255 | 1,492 | 1,429 |
125
  | CatalanQA | QA | 21,427 | 17,135 | 2,157 | 2,135 |
 
 
 
126
 
127
  ### Evaluation results
128
 
129
  This is how it compares to its teacher when fine-tuned on the aforementioned downstream tasks:
130
 
131
- | Model \ Task | NER (F1) |POS (F1)|STS-ca (Comb)|TeCla (Acc.)| TEca (Acc.) | VilaQuAD (F1/EM)|ViquiQuAD (F1/EM)| CatalanQA (F1/EM) | XQuAD-ca <sup>1</sup> (F1/EM) |
132
- | ------------------------|:-------------:|:-------|:------------|:-----------|:------------|:----------------|:----------------|:----|:----|
133
- | RoBERTa-base-ca-v2 | 89.29 | 98.96 | 79.07 | 74.26 | 83.14 | 87.74/72.58 | 88.72/75.91 | 89.50/76.63 | 73.64/55.42 |
134
- | DistilRoBERTa-base-ca-v2| xx.xx | xx.xx | xx.xx | xx.xx | xx.xx | xx.xx/xx.xx | xx.xx/xx.xx | xx.xx/xx.xx | xx.xx/xx.xx |
135
 
136
  <sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
137
 
 
120
  | STS-ca | STS | 3,073 | 2,073 | 500 | 500 |
121
  | TeCla | TC | 137,775 | 110,203| 13,786| 13,786|
122
  | TE-ca | TE | 21,163 | 16,930 | 2,116 | 2,117 |
 
 
123
  | CatalanQA | QA | 21,427 | 17,135 | 2,157 | 2,135 |
124
+ | XQuAD-ca | QA | - | - | - | 1,189 |
125
+
126
+
127
 
128
  ### Evaluation results
129
 
130
  This is how it compares to its teacher when fine-tuned on the aforementioned downstream tasks:
131
 
132
+ | Model \ Task |NER (F1)|POS (F1)|STS-ca (Comb)|TeCla (Acc.)|TEca (Acc.)|CatalanQA (F1/EM)| XQuAD-ca <sup>1</sup> (F1/EM) |
133
+ | ------------------------|:-------|:-------|:------------|:-----------|:----------|:----------------|:------------------------------|
134
+ | RoBERTa-base-ca-v2 | 89.29 | 98.96 | 79.07 | 74.26 | 83.14 | 89.50/76.63 | 73.64/55.42 |
135
+ | DistilRoBERTa-base-ca-v2| xx.xx | xx.xx | xx.xx | xx.xx | xx.xx | xx.xx/xx.xx | xx.xx/xx.xx |
136
 
137
  <sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
138