BVendeville commited on
Commit
695bb7b
·
verified ·
1 Parent(s): 3f474f2

annotation app code-03953cd455f4+git-b277422-dirty

Browse files
Files changed (1) hide show
  1. guide.py +29 -12
guide.py CHANGED
@@ -21,7 +21,7 @@ VALIDITY_TEXTS = {
21
  "A": "We looked at 12 studies with 2,431 people over 65 living at home. Walking every day probably means fewer "
22
  "falls after one year. We do not know if it prevents broken bones.",
23
  "B": "Studies in people over 65 living at home suggest that walking every day probably helps prevent falls.",
24
- "C": "Older people who walk every day have fewer falls. Walking also helps prevent broken bones.",
25
  }
26
 
27
 
@@ -36,20 +36,36 @@ GUIDE = {
36
  For each document you see three simplifications (A, B, C) of the same scientific text, written to help the general
37
  public (non-expert readers) understand it. You do **not** see the original scientific text in this part.
38
 
 
 
 
39
  ### The questions
40
 
41
- 1. **Easiest to follow**: the text you understood with the least effort.
42
- 2. **Hardest to follow**: the text that took the most effort to understand.
43
- 3. **How much easier**: two short questions comparing the easiest with the middle one, and the middle one with the
44
- hardest: *negligible*, *small*, *moderate* or *large*.
 
 
 
 
 
 
 
 
 
45
 
46
  ### What to judge
47
 
48
- - Only how easy each text is to **read and understand**: the words, the sentences, how the ideas follow each other.
49
- - **Not** whether the content is correct or complete (you cannot check that here).
50
- - **Not** simply length: a short text can still be hard to follow.
 
 
 
 
51
 
52
- There are no right answers: we want your experience as a reader. Once you submit a document you cannot go back to it.
53
 
54
  ### Example
55
 
@@ -62,7 +78,8 @@ There are no right answers: we want your experience as a reader. Once you submit
62
  - A uses short sentences and everyday words.
63
  - B packs everything into one long sentence, with terms like "incidence" and "very low-certainty evidence".
64
  - C is about as easy as A, so "How much easier is A than C?" → *negligible*, and "How much easier is C than B?" →
65
- *large*. (C's claim about broken bones is wrong, but that is not what this part asks about.)
 
66
  """,
67
  "validity": f"""
68
  ### What you do
@@ -121,8 +138,8 @@ a box only when you find a real problem. Once you submit a document you cannot g
121
  - *Leaves out important information*: **B**. The original has two conclusions, about falls and about broken bones;
122
  B keeps only the first, so the reader never learns that the effect on broken bones is unknown.
123
  - *Contradicts the source*: **C**. It says walking helps prevent broken bones; the original says this is not known.
124
- - *More broadly than supported*: **C**. "Older people" drops "over 65" and "living at home", and "have fewer falls"
125
- presents a probable result as established.
126
  - **A** has none of these problems: nothing to tick for it.
127
  """,
128
  }
 
21
  "A": "We looked at 12 studies with 2,431 people over 65 living at home. Walking every day probably means fewer "
22
  "falls after one year. We do not know if it prevents broken bones.",
23
  "B": "Studies in people over 65 living at home suggest that walking every day probably helps prevent falls.",
24
+ "C": "Older people who walk every day probably have fewer falls. Walking also helps prevent broken bones.",
25
  }
26
 
27
 
 
36
  For each document you see three simplifications (A, B, C) of the same scientific text, written to help the general
37
  public (non-expert readers) understand it. You do **not** see the original scientific text in this part.
38
 
39
+ The three simplifications come from different sources. We want to compare these sources and find out how easy
40
+ their texts are to follow for a non-expert reader. Your answers tell us which simplifications readers find easier.
41
+
42
  ### The questions
43
 
44
+ #### 1. Easiest to follow
45
+
46
+ The simplification you understood with the least effort.
47
+
48
+ #### 2. Hardest to follow
49
+
50
+ The simplification that took the most effort to understand. It must be a different one from question 1.
51
+
52
+ #### 3. How much easier
53
+
54
+ Two short questions appear once you have answered 1 and 2. They compare the easiest with the middle one, and the
55
+ middle one with the hardest: *negligible*, *small*, *moderate* or *large*. If two texts feel about the same, answer
56
+ *negligible*: that is a normal answer.
57
 
58
  ### What to judge
59
 
60
+ - Only how easy each simplification is to **read and understand** for a non-expert reader: the words, the sentences,
61
+ how the ideas follow each other, how clearly the text is organised.
62
+ - **Not** whether the content is correct or complete: you cannot check that here, and another part of the study
63
+ does.
64
+ - **Not** simply length: a short text can still be hard to follow, and a longer one can be easy.
65
+
66
+ ### There is no right answer
67
 
68
+ We want your own experience as a reader. Once you submit a document you cannot go back to it.
69
 
70
  ### Example
71
 
 
78
  - A uses short sentences and everyday words.
79
  - B packs everything into one long sentence, with terms like "incidence" and "very low-certainty evidence".
80
  - C is about as easy as A, so "How much easier is A than C?" → *negligible*, and "How much easier is C than B?" →
81
+ *large*.
82
+ - C's claim about broken bones is wrong, but that does not matter in this part: only how easy it is to follow.
83
  """,
84
  "validity": f"""
85
  ### What you do
 
138
  - *Leaves out important information*: **B**. The original has two conclusions, about falls and about broken bones;
139
  B keeps only the first, so the reader never learns that the effect on broken bones is unknown.
140
  - *Contradicts the source*: **C**. It says walking helps prevent broken bones; the original says this is not known.
141
+ - *More broadly than supported*: **C**. "Older people" is broader than "adults over 65 living at home": the original
142
+ says nothing about people aged 60, for instance, or living in care homes.
143
  - **A** has none of these problems: nothing to tick for it.
144
  """,
145
  }