Spaces:
Running
Running
annotation app code-03953cd455f4+git-b277422-dirty
Browse files
guide.py
CHANGED
|
@@ -21,7 +21,7 @@ VALIDITY_TEXTS = {
|
|
| 21 |
"A": "We looked at 12 studies with 2,431 people over 65 living at home. Walking every day probably means fewer "
|
| 22 |
"falls after one year. We do not know if it prevents broken bones.",
|
| 23 |
"B": "Studies in people over 65 living at home suggest that walking every day probably helps prevent falls.",
|
| 24 |
-
"C": "Older people who walk every day have fewer falls. Walking also helps prevent broken bones.",
|
| 25 |
}
|
| 26 |
|
| 27 |
|
|
@@ -36,20 +36,36 @@ GUIDE = {
|
|
| 36 |
For each document you see three simplifications (A, B, C) of the same scientific text, written to help the general
|
| 37 |
public (non-expert readers) understand it. You do **not** see the original scientific text in this part.
|
| 38 |
|
|
|
|
|
|
|
|
|
|
| 39 |
### The questions
|
| 40 |
|
| 41 |
-
1.
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
|
| 46 |
### What to judge
|
| 47 |
|
| 48 |
-
- Only how easy each
|
| 49 |
-
|
| 50 |
-
- **Not**
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
|
| 52 |
-
|
| 53 |
|
| 54 |
### Example
|
| 55 |
|
|
@@ -62,7 +78,8 @@ There are no right answers: we want your experience as a reader. Once you submit
|
|
| 62 |
- A uses short sentences and everyday words.
|
| 63 |
- B packs everything into one long sentence, with terms like "incidence" and "very low-certainty evidence".
|
| 64 |
- C is about as easy as A, so "How much easier is A than C?" → *negligible*, and "How much easier is C than B?" →
|
| 65 |
-
*large*.
|
|
|
|
| 66 |
""",
|
| 67 |
"validity": f"""
|
| 68 |
### What you do
|
|
@@ -121,8 +138,8 @@ a box only when you find a real problem. Once you submit a document you cannot g
|
|
| 121 |
- *Leaves out important information*: **B**. The original has two conclusions, about falls and about broken bones;
|
| 122 |
B keeps only the first, so the reader never learns that the effect on broken bones is unknown.
|
| 123 |
- *Contradicts the source*: **C**. It says walking helps prevent broken bones; the original says this is not known.
|
| 124 |
-
- *More broadly than supported*: **C**. "Older people"
|
| 125 |
-
|
| 126 |
- **A** has none of these problems: nothing to tick for it.
|
| 127 |
""",
|
| 128 |
}
|
|
|
|
| 21 |
"A": "We looked at 12 studies with 2,431 people over 65 living at home. Walking every day probably means fewer "
|
| 22 |
"falls after one year. We do not know if it prevents broken bones.",
|
| 23 |
"B": "Studies in people over 65 living at home suggest that walking every day probably helps prevent falls.",
|
| 24 |
+
"C": "Older people who walk every day probably have fewer falls. Walking also helps prevent broken bones.",
|
| 25 |
}
|
| 26 |
|
| 27 |
|
|
|
|
| 36 |
For each document you see three simplifications (A, B, C) of the same scientific text, written to help the general
|
| 37 |
public (non-expert readers) understand it. You do **not** see the original scientific text in this part.
|
| 38 |
|
| 39 |
+
The three simplifications come from different sources. We want to compare these sources and find out how easy
|
| 40 |
+
their texts are to follow for a non-expert reader. Your answers tell us which simplifications readers find easier.
|
| 41 |
+
|
| 42 |
### The questions
|
| 43 |
|
| 44 |
+
#### 1. Easiest to follow
|
| 45 |
+
|
| 46 |
+
The simplification you understood with the least effort.
|
| 47 |
+
|
| 48 |
+
#### 2. Hardest to follow
|
| 49 |
+
|
| 50 |
+
The simplification that took the most effort to understand. It must be a different one from question 1.
|
| 51 |
+
|
| 52 |
+
#### 3. How much easier
|
| 53 |
+
|
| 54 |
+
Two short questions appear once you have answered 1 and 2. They compare the easiest with the middle one, and the
|
| 55 |
+
middle one with the hardest: *negligible*, *small*, *moderate* or *large*. If two texts feel about the same, answer
|
| 56 |
+
*negligible*: that is a normal answer.
|
| 57 |
|
| 58 |
### What to judge
|
| 59 |
|
| 60 |
+
- Only how easy each simplification is to **read and understand** for a non-expert reader: the words, the sentences,
|
| 61 |
+
how the ideas follow each other, how clearly the text is organised.
|
| 62 |
+
- **Not** whether the content is correct or complete: you cannot check that here, and another part of the study
|
| 63 |
+
does.
|
| 64 |
+
- **Not** simply length: a short text can still be hard to follow, and a longer one can be easy.
|
| 65 |
+
|
| 66 |
+
### There is no right answer
|
| 67 |
|
| 68 |
+
We want your own experience as a reader. Once you submit a document you cannot go back to it.
|
| 69 |
|
| 70 |
### Example
|
| 71 |
|
|
|
|
| 78 |
- A uses short sentences and everyday words.
|
| 79 |
- B packs everything into one long sentence, with terms like "incidence" and "very low-certainty evidence".
|
| 80 |
- C is about as easy as A, so "How much easier is A than C?" → *negligible*, and "How much easier is C than B?" →
|
| 81 |
+
*large*.
|
| 82 |
+
- C's claim about broken bones is wrong, but that does not matter in this part: only how easy it is to follow.
|
| 83 |
""",
|
| 84 |
"validity": f"""
|
| 85 |
### What you do
|
|
|
|
| 138 |
- *Leaves out important information*: **B**. The original has two conclusions, about falls and about broken bones;
|
| 139 |
B keeps only the first, so the reader never learns that the effect on broken bones is unknown.
|
| 140 |
- *Contradicts the source*: **C**. It says walking helps prevent broken bones; the original says this is not known.
|
| 141 |
+
- *More broadly than supported*: **C**. "Older people" is broader than "adults over 65 living at home": the original
|
| 142 |
+
says nothing about people aged 60, for instance, or living in care homes.
|
| 143 |
- **A** has none of these problems: nothing to tick for it.
|
| 144 |
""",
|
| 145 |
}
|