YI Zhongyue commited on
Commit ·
3f36a98
1
Parent(s): 53a226a
update GAIA_answer_formatter_prompt
Browse files
prompt.py
CHANGED
|
@@ -299,6 +299,53 @@ GAIA FORMAT REQUIREMENTS:
|
|
| 299 |
- If asked for a string: no articles (a, an, the), no abbreviations (e.g. for cities), write digits in plain text unless specified
|
| 300 |
- If asked for a comma separated list: apply above rules for each element
|
| 301 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 302 |
ORIGINAL QUESTION:
|
| 303 |
{question}
|
| 304 |
|
|
|
|
| 299 |
- If asked for a string: no articles (a, an, the), no abbreviations (e.g. for cities), write digits in plain text unless specified
|
| 300 |
- If asked for a comma separated list: apply above rules for each element
|
| 301 |
|
| 302 |
+
EXAMPLES:
|
| 303 |
+
|
| 304 |
+
Example 1 - Single word answer:
|
| 305 |
+
Question: "According to the abstract of a research article published in Science Advances in 2021, beads made from the shells of this species were found that are at least how many thousands of years old?"
|
| 306 |
+
Agent's answer: "The beads are at least 142 thousand years old according to the research."
|
| 307 |
+
Correct format: <formated_answer>142</formated_answer>
|
| 308 |
+
|
| 309 |
+
Example 2 - Simple string answer:
|
| 310 |
+
Question: "What two-word type of model did these studies have in common (no punctuation)?"
|
| 311 |
+
Agent's answer: "The studies both used a beta geometric model approach."
|
| 312 |
+
Correct format: <formated_answer>beta geometric</formated_answer>
|
| 313 |
+
|
| 314 |
+
Example 3 - Decimal number:
|
| 315 |
+
Question: "Report the answer in Angstroms, rounded to the nearest picometer."
|
| 316 |
+
Agent's answer: "The distance is 1.4564234018325806 Å, which rounds to 1.456 Angstroms."
|
| 317 |
+
Correct format: <formated_answer>1.456</formated_answer>
|
| 318 |
+
|
| 319 |
+
Example 4 - Comma-separated list:
|
| 320 |
+
Question: "I need the answer formatted as the five-digit zip codes of the places the species was found, separated by commas if there is more than one place."
|
| 321 |
+
Agent's answer: "The species was found in two locations: 34689 and 12345."
|
| 322 |
+
Correct format: <formated_answer>34689, 12345</formated_answer>
|
| 323 |
+
|
| 324 |
+
Example 5 - Simple zip code:
|
| 325 |
+
Question: "I need the answer formatted as the five-digit zip codes of the places the species was found, separated by commas if there is more than one place."
|
| 326 |
+
Agent's answer: "Based on my research, the clownfish was only found at Fred Howard Park, which has zip code 34689."
|
| 327 |
+
Correct format: <formated_answer>34689</formated_answer>
|
| 328 |
+
|
| 329 |
+
Example 6 - Name format:
|
| 330 |
+
Question: "Answer using the format First name Last name"
|
| 331 |
+
Agent's answer: "The scientist who made the prediction was Dr. Claude Shannon from Bell Labs."
|
| 332 |
+
Correct format: <formated_answer>Claude Shannon</formated_answer>
|
| 333 |
+
|
| 334 |
+
Example 7 - Date format:
|
| 335 |
+
Question: "According to github, when was Regression added to the oldest closed numpy.polynomial issue that has the Regression label in MM/DD/YY?"
|
| 336 |
+
Agent's answer: "The Regression label was added on April 15, 2018."
|
| 337 |
+
Correct format: <formated_answer>04/15/18</formated_answer>
|
| 338 |
+
|
| 339 |
+
Example 8 - Percentage as integer:
|
| 340 |
+
Question: "What is the percentage (to the nearest percent) of those standards that have been superseded?"
|
| 341 |
+
Agent's answer: "86.7% of the standards have been superseded, which rounds to 87%."
|
| 342 |
+
Correct format: <formated_answer>86</formated_answer>
|
| 343 |
+
|
| 344 |
+
Example 9 - Location names (alphabetical):
|
| 345 |
+
Question: "Answer using a comma separated list, ordering the countries by alphabetical order."
|
| 346 |
+
Agent's answer: "The two countries furthest apart are Myanmar and Indonesia."
|
| 347 |
+
Correct format: <formated_answer>Indonesia, Myanmar</formated_answer>
|
| 348 |
+
|
| 349 |
ORIGINAL QUESTION:
|
| 350 |
{question}
|
| 351 |
|