Update README.md
Browse files
README.md
CHANGED
|
@@ -1,48 +1,56 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
|
| 22 |
-
|
|
| 23 |
-
|
|
| 24 |
-
|
|
| 25 |
-
|
|
| 26 |
-
|
|
| 27 |
-
|
|
| 28 |
-
|
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: llama3.1
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
base_model:
|
| 6 |
+
- meta-llama/Llama-3.1-8B-Instruct
|
| 7 |
+
pipeline_tag: robotics
|
| 8 |
+
---
|
| 9 |
+
# EmbodiedAgent
|
| 10 |
+
|
| 11 |
+
Model release for paper: *EmbodiedAgent: A Scalable Hierarchical Approach to Overcome Practical Challenge in Multi-Robot Control*
|
| 12 |
+
|
| 13 |
+

|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
|
| 17 |
+
|
| 18 |
+
|
| 19 |
+
# Results
|
| 20 |
+
|
| 21 |
+
| Model | Infer type | ASR_{top-k} | Expert grading | UE | PoE | PlE | SE | EE | RPAS|
|
| 22 |
+
| ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- |
|
| 23 |
+
|GPT-4o | FPS | 9.03 | 31.25 | 0.00 | 0.00 | 6.25 | 93.75 | 0.00 | 20.14 |
|
| 24 |
+
|OpenAI-o1 | FPS | 6.74 | 34.38 | 0.00 | 0.00 | 3.12 | 96.88 | 0.00 | 20.56|
|
| 25 |
+
|Claude-3.5-Sonnet | FPS | 37.5 | 32.19 | 0.00 | 0.00 | 0.00 | 0.00 | 62.5 | 34.85 |
|
| 26 |
+
|Deepseek-R1 | FPS | 61.87 | 64.84 | 0.00 | 18.75 | 15.62 | 0.00 | 18.75 | 63.36|
|
| 27 |
+
|Deepseek-R1-Distill-Llama3.3-70B | NAP | 33.70 | 60.00 | 3.12 | 59.38 | 3.12 | 0.00 | 21.88 | 46.85|
|
| 28 |
+
|LLaMA-3.1-8B | NAP | 16.56 | 43.44 | 3.12 | 71.88 | 50.00 | 18.75 | 3.12 | 30.00 |
|
| 29 |
+
|LLaMA-3.1-70B | NAP | 27.50 | 40.94 | 0.00 | 9.38 | 87.5 | 62.5 | 21.88 | 34.22 |
|
| 30 |
+
|LLaMA-3.1-405B | NAP | 34.24 | 61.09 | 28.12 | 46.88 | 6.25 | 0.00 | 0.00 | 47.67 |
|
| 31 |
+
|LLaMA-3.3-70B | NAP | 46.02 | 60.31 | 0.00 | 48.48 | 39.39 | 15.15 | 6.06 | 53.26 |
|
| 32 |
+
|Gemma-2-9B | NAP | 17.36 | 29.06 | 31.25 | 34.38 | 25.0 | 0.00 | 6.25 | 23.21 |
|
| 33 |
+
|Qwen2.5-7B | NAP | 9.17 | 10.94 | 3.12 | 15.62 | 90.62 | 0.00 | 6.25 | 10.06 |
|
| 34 |
+
|Qwen2.5-72B | NAP | 40.42 | 50.62 | 0.00 | 56.25 | 18.75 | 0.00 | 6.25 | 45.52 |
|
| 35 |
+
|MAP-Neo-7B-Multiplan | FPS | 46.39 | 44.22 | 21.88 | 28.12 | 25.0 | 6.25 | 3.12 | 45.31 |
|
| 36 |
+
|EmbodiedAgent (Ours) | NAP | **74.01** | **69.69** | 9.38 | 15.62 | 3.12 | 9.38 | 0.00 | **71.85** |
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
|
| 40 |
+
|
| 41 |
+
|
| 42 |
+
# Links
|
| 43 |
+
|
| 44 |
+
Code: [EmbodiedAgent](https://github.com/HaronW/EmbodiedAgent)
|
| 45 |
+
|
| 46 |
+
Dataset: [MultiPlan+](https://github.com/HaronW/MultiPlan_plus)
|
| 47 |
+
|
| 48 |
+
Model weight: [LLaMA-3.1-8B-Multiplan_Plus_NAP](https://huggingface.co/HaronW/LLaMA-3.1-8B-Multiplan_Plus_NAP)
|
| 49 |
+
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
|
| 54 |
+
# License
|
| 55 |
+
|
| 56 |
+
EmbodiedAgent is released under the llama3.1 License. See the LICENSE file for more details.
|