Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,19 @@ doc_stride = 128
|
|
| 15 |
```
|
| 16 |
|
| 17 |
## Squad 2 Evaluation stats:
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
## Limitations
|
| 21 |
MuRIL is specifically trained to work on 18 Indic languages and English. This model is not expected to perform well in any other languages. See the MuRIL checkpoint for further details.
|
|
|
|
| 15 |
```
|
| 16 |
|
| 17 |
## Squad 2 Evaluation stats:
|
| 18 |
+
```json
|
| 19 |
+
{
|
| 20 |
+
"exact": 82.0180240882675,
|
| 21 |
+
"f1": 85.10110304685352,
|
| 22 |
+
"total": 11873,
|
| 23 |
+
"HasAns_exact": 81.6970310391363,
|
| 24 |
+
"HasAns_f1": 87.87203044454981,
|
| 25 |
+
"HasAns_total": 5928,
|
| 26 |
+
"NoAns_exact": 82.3380992430614,
|
| 27 |
+
"NoAns_f1": 82.3380992430614,
|
| 28 |
+
"NoAns_total": 5945
|
| 29 |
+
}
|
| 30 |
+
```
|
| 31 |
|
| 32 |
## Limitations
|
| 33 |
MuRIL is specifically trained to work on 18 Indic languages and English. This model is not expected to perform well in any other languages. See the MuRIL checkpoint for further details.
|