Update README.md
Browse files
README.md
CHANGED
|
@@ -40,6 +40,7 @@ A collection of 10 benchmarks:
|
|
| 40 |
| Model | Below/Above | Left/Right | Big/Small | Tall/Short | Wide/Thin | Behind/Front | Avg |
|
| 41 |
|:-----------------------:|:------------:|:-----------:|:----------:|:-----------:|:----------:|:-------------:|:-------------: |
|
| 42 |
| LLaVA-1.5-7b | 53.91 | 53.49 | 45.36 | 40.00 | **50.00** | 51.04 | 48.97 |
|
|
|
|
| 43 |
| Spatial-LLaVA-7b | **56.32** | **66.28** | **60.82** | **48.57** | 49.02 | **52.08** | **55.12** |
|
| 44 |
|
| 45 |
### Quantitative Spatial Relations
|
|
@@ -47,6 +48,7 @@ A collection of 10 benchmarks:
|
|
| 47 |
| Model | Direct Dist (m / ratio) | Horizontal Dist (m / ratio) | Vertical Dist (m / ratio) | Width (m / ratio) | Height (m / ratio) | Direction (° / ratio) |
|
| 48 |
|:-----------------------:|:------------------------:|:----------------------------:|:--------------------------:|:--------------------------:|:--------------------------:|:--------------------------:|
|
| 49 |
| LLaVA-1.5-7b | 12.90 / 1.06 | 10.68 / 2.03 | 20.79 / 0.94 | **24.19 / 0.50** | 14.29 / 5.27 | 10.23 / 58.33 |
|
|
|
|
| 50 |
| Spatial-LLaVA-7b | **24.19 / 0.57** | **14.56 / 0.62** | **41.58 / 0.42** | 22.58 / 1.12 | **18.25 / 2.92** | **20.45 / 56.47** |
|
| 51 |
|
| 52 |
## 🙏 Acknowledgements
|
|
|
|
| 40 |
| Model | Below/Above | Left/Right | Big/Small | Tall/Short | Wide/Thin | Behind/Front | Avg |
|
| 41 |
|:-----------------------:|:------------:|:-----------:|:----------:|:-----------:|:----------:|:-------------:|:-------------: |
|
| 42 |
| LLaVA-1.5-7b | 53.91 | 53.49 | 45.36 | 40.00 | **50.00** | 51.04 | 48.97 |
|
| 43 |
+
| LLaVA-1.5-13b | 54.28 | 52.32 | 45.36 | 48.57 | 49.02 | 47.92 | 49.67 |
|
| 44 |
| Spatial-LLaVA-7b | **56.32** | **66.28** | **60.82** | **48.57** | 49.02 | **52.08** | **55.12** |
|
| 45 |
|
| 46 |
### Quantitative Spatial Relations
|
|
|
|
| 48 |
| Model | Direct Dist (m / ratio) | Horizontal Dist (m / ratio) | Vertical Dist (m / ratio) | Width (m / ratio) | Height (m / ratio) | Direction (° / ratio) |
|
| 49 |
|:-----------------------:|:------------------------:|:----------------------------:|:--------------------------:|:--------------------------:|:--------------------------:|:--------------------------:|
|
| 50 |
| LLaVA-1.5-7b | 12.90 / 1.06 | 10.68 / 2.03 | 20.79 / 0.94 | **24.19 / 0.50** | 14.29 / 5.27 | 10.23 / 58.33 |
|
| 51 |
+
| LLaVA-1.5-13b | 13.71 / 0.93 | 10.68 / 3.56 | 16.83 / 0.85 | 15.32 / 0.57 | 17.67 / 5.8 | 14.77 / 54.29 |
|
| 52 |
| Spatial-LLaVA-7b | **24.19 / 0.57** | **14.56 / 0.62** | **41.58 / 0.42** | 22.58 / 1.12 | **18.25 / 2.92** | **20.45 / 56.47** |
|
| 53 |
|
| 54 |
## 🙏 Acknowledgements
|