YI Zhongyue commited on
Commit
e5bfc40
·
1 Parent(s): 3f36a98

update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -17,6 +17,22 @@ hf_oauth_expiration_minutes: 480
17
 
18
  This is a multi-agent system developed for the [Hugging Face Agents Course](https://huggingface.co/learn/agents-course/en/unit4/introduction) Unit 4 final project. The system is designed to evaluate AI agent performance through the [GAIA benchmark](https://huggingface.co/spaces/gaia-benchmark/leaderboard).
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## 🏗️ Architecture Design
21
 
22
  This project adopts a multi-agent architecture with two specialized sub-agents:
 
17
 
18
  This is a multi-agent system developed for the [Hugging Face Agents Course](https://huggingface.co/learn/agents-course/en/unit4/introduction) Unit 4 final project. The system is designed to evaluate AI agent performance through the [GAIA benchmark](https://huggingface.co/spaces/gaia-benchmark/leaderboard).
19
 
20
+ Due to the fact that this agent system does not provide file processing capabilities, multimodal reasoning, and other advanced features, some questions like the following cannot be answered by this agent system:
21
+
22
+ > The attached Excel file contains the sales of menu items for a local fast-food chain. What were the total sales that the chain made from food (not including drinks)? Express your answer in USD with two decimal places.
23
+
24
+ > Review the chess position provided in the image. It is black's turn. Provide the correct next move for black which guarantees a win. Please provide your response in algebraic notation.
25
+
26
+ > In the video https://www.youtube.com/watch?v=L1vXCYZAYYM, what is the highest number of bird species to be on camera simultaneously?
27
+
28
+ Even so, this agent system is able to pass the GAIA benchmark with a score of 50% by correctly answering 10 out of 20 questions.
29
+
30
+ > Submission Successful!
31
+ > User: Hemimoon
32
+ > Overall Score: 50.0% (10/20 correct)
33
+ > Message: Score calculated successfully: 10/20 total questions answered correctly (20 valid tasks attempted). High score updated on leaderboard.
34
+
35
+
36
  ## 🏗️ Architecture Design
37
 
38
  This project adopts a multi-agent architecture with two specialized sub-agents: