HaronW commited on
Commit
c89d3e9
·
verified ·
1 Parent(s): 484792f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -48
README.md CHANGED
@@ -1,48 +1,56 @@
1
- # EmbodiedAgent
2
-
3
- Model release for paper: *EmbodiedAgent: A Scalable Hierarchical Approach to Overcome Practical Challenge in Multi-Robot Control*
4
-
5
- ![figure](./figure.png)
6
-
7
-
8
-
9
-
10
-
11
- # Results
12
-
13
- | Model | Infer type | ASR_{top-k} | Expert grading | UE | PoE | PlE | SE | EE | RPAS|
14
- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- |
15
- |GPT-4o | FPS | 9.03 | 31.25 | 0.00 | 0.00 | 6.25 | 93.75 | 0.00 | 20.14 |
16
- |OpenAI-o1 | FPS | 6.74 | 34.38 | 0.00 | 0.00 | 3.12 | 96.88 | 0.00 | 20.56|
17
- |Claude-3.5-Sonnet | FPS | 37.5 | 32.19 | 0.00 | 0.00 | 0.00 | 0.00 | 62.5 | 34.85 |
18
- |Deepseek-R1 | FPS | 61.87 | 64.84 | 0.00 | 18.75 | 15.62 | 0.00 | 18.75 | 63.36|
19
- |Deepseek-R1-Distill-Llama3.3-70B | NAP | 33.70 | 60.00 | 3.12 | 59.38 | 3.12 | 0.00 | 21.88 | 46.85|
20
- |LLaMA-3.1-8B | NAP | 16.56 | 43.44 | 3.12 | 71.88 | 50.00 | 18.75 | 3.12 | 30.00 |
21
- |LLaMA-3.1-70B | NAP | 27.50 | 40.94 | 0.00 | 9.38 | 87.5 | 62.5 | 21.88 | 34.22 |
22
- |LLaMA-3.1-405B | NAP | 34.24 | 61.09 | 28.12 | 46.88 | 6.25 | 0.00 | 0.00 | 47.67 |
23
- |LLaMA-3.3-70B | NAP | 46.02 | 60.31 | 0.00 | 48.48 | 39.39 | 15.15 | 6.06 | 53.26 |
24
- |Gemma-2-9B | NAP | 17.36 | 29.06 | 31.25 | 34.38 | 25.0 | 0.00 | 6.25 | 23.21 |
25
- |Qwen2.5-7B | NAP | 9.17 | 10.94 | 3.12 | 15.62 | 90.62 | 0.00 | 6.25 | 10.06 |
26
- |Qwen2.5-72B | NAP | 40.42 | 50.62 | 0.00 | 56.25 | 18.75 | 0.00 | 6.25 | 45.52 |
27
- |MAP-Neo-7B-Multiplan | FPS | 46.39 | 44.22 | 21.88 | 28.12 | 25.0 | 6.25 | 3.12 | 45.31 |
28
- |EmbodiedAgent (Ours) | NAP | **74.01** | **69.69** | 9.38 | 15.62 | 3.12 | 9.38 | 0.00 | **71.85** |
29
-
30
-
31
-
32
-
33
-
34
- # Links
35
-
36
- Code: [EmbodiedAgent](https://github.com/HaronW/EmbodiedAgent)
37
-
38
- Dataset: [MultiPlan+](https://github.com/HaronW/MultiPlan_plus)
39
-
40
- Model weight: [LLaMA-3.1-8B-Multiplan_Plus_NAP](https://huggingface.co/HaronW/LLaMA-3.1-8B-Multiplan_Plus_NAP)
41
-
42
-
43
-
44
-
45
-
46
- # License
47
-
48
- EmbodiedAgent is released under the llama3.1 License. See the LICENSE file for more details.
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.1
3
+ language:
4
+ - en
5
+ base_model:
6
+ - meta-llama/Llama-3.1-8B-Instruct
7
+ pipeline_tag: robotics
8
+ ---
9
+ # EmbodiedAgent
10
+
11
+ Model release for paper: *EmbodiedAgent: A Scalable Hierarchical Approach to Overcome Practical Challenge in Multi-Robot Control*
12
+
13
+ ![figure](./figure.png)
14
+
15
+
16
+
17
+
18
+
19
+ # Results
20
+
21
+ | Model | Infer type | ASR_{top-k} | Expert grading | UE | PoE | PlE | SE | EE | RPAS|
22
+ | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- |
23
+ |GPT-4o | FPS | 9.03 | 31.25 | 0.00 | 0.00 | 6.25 | 93.75 | 0.00 | 20.14 |
24
+ |OpenAI-o1 | FPS | 6.74 | 34.38 | 0.00 | 0.00 | 3.12 | 96.88 | 0.00 | 20.56|
25
+ |Claude-3.5-Sonnet | FPS | 37.5 | 32.19 | 0.00 | 0.00 | 0.00 | 0.00 | 62.5 | 34.85 |
26
+ |Deepseek-R1 | FPS | 61.87 | 64.84 | 0.00 | 18.75 | 15.62 | 0.00 | 18.75 | 63.36|
27
+ |Deepseek-R1-Distill-Llama3.3-70B | NAP | 33.70 | 60.00 | 3.12 | 59.38 | 3.12 | 0.00 | 21.88 | 46.85|
28
+ |LLaMA-3.1-8B | NAP | 16.56 | 43.44 | 3.12 | 71.88 | 50.00 | 18.75 | 3.12 | 30.00 |
29
+ |LLaMA-3.1-70B | NAP | 27.50 | 40.94 | 0.00 | 9.38 | 87.5 | 62.5 | 21.88 | 34.22 |
30
+ |LLaMA-3.1-405B | NAP | 34.24 | 61.09 | 28.12 | 46.88 | 6.25 | 0.00 | 0.00 | 47.67 |
31
+ |LLaMA-3.3-70B | NAP | 46.02 | 60.31 | 0.00 | 48.48 | 39.39 | 15.15 | 6.06 | 53.26 |
32
+ |Gemma-2-9B | NAP | 17.36 | 29.06 | 31.25 | 34.38 | 25.0 | 0.00 | 6.25 | 23.21 |
33
+ |Qwen2.5-7B | NAP | 9.17 | 10.94 | 3.12 | 15.62 | 90.62 | 0.00 | 6.25 | 10.06 |
34
+ |Qwen2.5-72B | NAP | 40.42 | 50.62 | 0.00 | 56.25 | 18.75 | 0.00 | 6.25 | 45.52 |
35
+ |MAP-Neo-7B-Multiplan | FPS | 46.39 | 44.22 | 21.88 | 28.12 | 25.0 | 6.25 | 3.12 | 45.31 |
36
+ |EmbodiedAgent (Ours) | NAP | **74.01** | **69.69** | 9.38 | 15.62 | 3.12 | 9.38 | 0.00 | **71.85** |
37
+
38
+
39
+
40
+
41
+
42
+ # Links
43
+
44
+ Code: [EmbodiedAgent](https://github.com/HaronW/EmbodiedAgent)
45
+
46
+ Dataset: [MultiPlan+](https://github.com/HaronW/MultiPlan_plus)
47
+
48
+ Model weight: [LLaMA-3.1-8B-Multiplan_Plus_NAP](https://huggingface.co/HaronW/LLaMA-3.1-8B-Multiplan_Plus_NAP)
49
+
50
+
51
+
52
+
53
+
54
+ # License
55
+
56
+ EmbodiedAgent is released under the llama3.1 License. See the LICENSE file for more details.