| ***Pick coke can results*** |
| -------------------- |
| horizontal sim variant avg success {'OpenVLA-0.5B': 0.2666666666666667} |
| vertical sim variant avg success {'OpenVLA-0.5B': 0.08444444444444445} |
| standing sim variant avg success {'OpenVLA-0.5B': 0.37777777777777777} |
| avg_orientation_sim_variant_results [0.24296296296296296] |
| -------------------- |
| Orientation horizontal, ckpt OpenVLA-0.5B all robot arm visual matching success: [0.24, 0.12, 0.16, 0.12] |
| Orientation vertical, ckpt OpenVLA-0.5B all robot arm visual matching success: [0.08, 0.0, 0.0, 0.04] |
| Orientation standing, ckpt OpenVLA-0.5B all robot arm visual matching success: [0.12, 0.08, 0.2, 0.12] |
| horizontal visual matching sim success {'OpenVLA-0.5B': 0.16} |
| vertical visual matching sim success {'OpenVLA-0.5B': 0.03} |
| standing visual matching sim success {'OpenVLA-0.5B': 0.13} |
| avg_orientation_sim_visual_matching_results [0.10666666666666667] |
| ******************** |
|
|
|
|
|
|
| ***Move Near results*** |
| -------------------- |
| sim variant avg success {'OpenVLA-0.5B': 0.19} |
| -------------------- |
| Ckpt OpenVLA-0.5B all robot arm visual matching success: [0.16, 0.12, 0.24, 0.16] |
| sim visual matching success {'OpenVLA-0.5B': 0.17} |
| ******************** |
|
|
|
|
|
|
| ***Drawer results*** |
| -------------------- |
| open sim variant avg success {'OpenVLA-0.5B': 0.03174603174603175} |
| close sim variant avg success {'OpenVLA-0.5B': 0.2645502645502645} |
| avg_sim_variant_results [0.1481481481481481] |
| -------------------- |
| Drawer task open, ckpt OpenVLA-0.5B all robot arm visual matching success: [0.05555555555555555, 0.05555555555555555, 0.0, 0.037037037037037035] |
| Drawer task close, ckpt OpenVLA-0.5B all robot arm visual matching success: [0.41666666666666663, 0.4722222222222222, 0.2777777777777778, 0.4074074074074074] |
| open visual matching sim success {'OpenVLA-0.5B': 0.037037037037037035} |
| close visual matching sim success {'OpenVLA-0.5B': 0.38888888888888884} |
| avg_sim_visual_matching_results [0.21296296296296294] |
| ******************** |
|
|
|
|
|
|
| ***Drawer results*** |
| -------------------- |
| put_apple_into_top_drawer sim variant avg success {'OpenVLA-0.5B': 0.005714285714285714} |
| avg_sim_variant_results [0.005714285714285714] |
| -------------------- |
| Drawer task put_apple_into_top_drawer, ckpt OpenVLA-0.5B all robot arm visual matching success: [0.0, 0.0, 0.0, 0.0] |
| put_apple_into_top_drawer visual matching sim success {'OpenVLA-0.5B': 0.0} |
| avg_sim_visual_matching_results [0.0] |
| ******************** |
|
|
|
|
|
|
| ***Bridge Put On Env results*** |
| ********** Results for put_spoon_on_tablecloth ********** |
| sim visual matching partial success {'OpenVLA-0.5B': 0.16666666666666666} |
| sim visual matching success {'OpenVLA-0.5B': 0.0} |
| ******************** |
|
|
|
|
|
|
| ********** Results for put_carrot_on_plate ********** |
| sim visual matching partial success {'OpenVLA-0.5B': 0.20833333333333334} |
| sim visual matching success {'OpenVLA-0.5B': 0.0} |
| ******************** |
|
|
|
|
|
|
| ********** Results for stack_green_block_on_yellow_block ********** |
| sim visual matching partial success {'OpenVLA-0.5B': 0.08333333333333333} |
| sim visual matching success {'OpenVLA-0.5B': 0.0} |
| ******************** |
|
|
|
|
|
|
| ********** Results for put_eggplant_in_basket ********** |
| sim visual matching partial success {'OpenVLA-0.5B': 0.625} |
| sim visual matching success {'OpenVLA-0.5B': 0.16666666666666666} |
| ******************** |
|
|
|
|
|
|
|
|
| google_var: |
| 24.3 |
| 19.0 |
| 14.8 |
| 0.6 |
|
|
| google_matching |
| 10.7 |
| 17.0 |
| 21.3 |
| 0.0 |
|
|
| widowx_matching |
| 0.0 |
| 0.0 |
| 0.0 |
| 16.7 |
|
|
