Spaces:
Sleeping
Sleeping
| """Task instruction for icon evaluation.""" | |
| login_instruction = """ | |
| ## Login | |
| Every time you start evaluating, input your user ID (e.g.: janeding) in the input box, and click the "Start/Resume" button. This will load your previous evaluation progress if you have logged in before. | |
| """ | |
| q1_instruction = """ | |
| ## Question 1: Relevance Score (1-5) | |
| Rate how relevant the icon is to the given label on a scale of 1 to 5. | |
| ### Your answer should be mainly based on your first intuition, but you may adjust it after viewing the label. | |
| - **5**: Strongly related (highly consistent with the label, clear match) | |
| - **4**: Moderately related (clear partial connection, overall closer to related) | |
| - **3**: Neutral/uncertain (ambiguous, could be seen as either related or unrelated) | |
| - **2**: Weakly related (some minor or indirect connection, overall closer to unrelated) | |
| - **1**: Completely unrelated (no clear connection) | |
| """ | |
| q2_instruction = """ | |
| ## Question 2: Keyword Presence | |
| Check the 10 keywords and indicate which ones are **NOT** visible in the icon image: | |
| - Select **specific keywords** that are **missing** from the image, OR | |
| - Select **"ALL WORDS PRESENT"** if all 10 keywords are visible in the image | |
| You must select at least one option (either specific missing keywords or "ALL WORDS PRESENT") | |
| """ | |
| important_notes_instruction = """ | |
| ## Notes | |
| - Always **SUBMIT** your answer. | |
| - You can resume from where you left off by logging in with the same User ID. | |
| - You can modify your previous answers by navigating back. | |
| """ | |
| nav_instruction = """ | |
| ## Navigation | |
| - **Submit and Next**: Submit your answer and move to the next icon | |
| - **Next**: Navigate forward (up to your latest progress) | |
| - **Prev**: Navigate backward to review previous answers | |
| - **Jump to**: Jump to a specific index (1-indexed, up to your latest progress) | |
| """ | |