Update content.py
Browse files- content.py +2 -2
content.py
CHANGED
|
@@ -26,7 +26,7 @@ SUBMISSION_TEXT = """
|
|
| 26 |
## Submissions
|
| 27 |
Results can be submitted for the test set only. Scores are expressed as the percentage of correct answers for a given split.
|
| 28 |
|
| 29 |
-
Evaluation is done by comparing the newly generated question to the reference questions using Semantic Text Similarity, and inheriting the label of the most similar reference. Questions
|
| 30 |
|
| 31 |
We expect submissions to be json files with the following format.
|
| 32 |
```json
|
|
@@ -56,7 +56,7 @@ We expect submissions to be json files with the following format.
|
|
| 56 |
|
| 57 |
After clicking 'Submit Eval' wait for a couple of minutes before trying to refresh.
|
| 58 |
|
| 59 |
-
If you find any issues, please email
|
| 60 |
|
| 61 |
"""
|
| 62 |
|
|
|
|
| 26 |
## Submissions
|
| 27 |
Results can be submitted for the test set only. Scores are expressed as the percentage of correct answers for a given split.
|
| 28 |
|
| 29 |
+
Evaluation is done by comparing the newly generated question to the reference questions using Semantic Text Similarity, and inheriting the label of the most similar reference. Questions where no reference is found are considered invalid. See the evaluation function [here](https://huggingface.co/spaces/HiTZ/Critical_Questions_Leaderboard/blob/main/app.py#L141), or find more details in the [paper](https://arxiv.org/abs/2505.11341).
|
| 30 |
|
| 31 |
We expect submissions to be json files with the following format.
|
| 32 |
```json
|
|
|
|
| 56 |
|
| 57 |
After clicking 'Submit Eval' wait for a couple of minutes before trying to refresh.
|
| 58 |
|
| 59 |
+
If you find any issues, please email blanca.calvo@ehu.eus
|
| 60 |
|
| 61 |
"""
|
| 62 |
|