YI Zhongyue commited on
Commit ·
e5bfc40
1
Parent(s): 3f36a98
update README.md
Browse files
README.md
CHANGED
|
@@ -17,6 +17,22 @@ hf_oauth_expiration_minutes: 480
|
|
| 17 |
|
| 18 |
This is a multi-agent system developed for the [Hugging Face Agents Course](https://huggingface.co/learn/agents-course/en/unit4/introduction) Unit 4 final project. The system is designed to evaluate AI agent performance through the [GAIA benchmark](https://huggingface.co/spaces/gaia-benchmark/leaderboard).
|
| 19 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
## 🏗️ Architecture Design
|
| 21 |
|
| 22 |
This project adopts a multi-agent architecture with two specialized sub-agents:
|
|
|
|
| 17 |
|
| 18 |
This is a multi-agent system developed for the [Hugging Face Agents Course](https://huggingface.co/learn/agents-course/en/unit4/introduction) Unit 4 final project. The system is designed to evaluate AI agent performance through the [GAIA benchmark](https://huggingface.co/spaces/gaia-benchmark/leaderboard).
|
| 19 |
|
| 20 |
+
Due to the fact that this agent system does not provide file processing capabilities, multimodal reasoning, and other advanced features, some questions like the following cannot be answered by this agent system:
|
| 21 |
+
|
| 22 |
+
> The attached Excel file contains the sales of menu items for a local fast-food chain. What were the total sales that the chain made from food (not including drinks)? Express your answer in USD with two decimal places.
|
| 23 |
+
|
| 24 |
+
> Review the chess position provided in the image. It is black's turn. Provide the correct next move for black which guarantees a win. Please provide your response in algebraic notation.
|
| 25 |
+
|
| 26 |
+
> In the video https://www.youtube.com/watch?v=L1vXCYZAYYM, what is the highest number of bird species to be on camera simultaneously?
|
| 27 |
+
|
| 28 |
+
Even so, this agent system is able to pass the GAIA benchmark with a score of 50% by correctly answering 10 out of 20 questions.
|
| 29 |
+
|
| 30 |
+
> Submission Successful!
|
| 31 |
+
> User: Hemimoon
|
| 32 |
+
> Overall Score: 50.0% (10/20 correct)
|
| 33 |
+
> Message: Score calculated successfully: 10/20 total questions answered correctly (20 valid tasks attempted). High score updated on leaderboard.
|
| 34 |
+
|
| 35 |
+
|
| 36 |
## 🏗️ Architecture Design
|
| 37 |
|
| 38 |
This project adopts a multi-agent architecture with two specialized sub-agents:
|