Update README.md
Browse files
README.md
CHANGED
|
@@ -8,13 +8,13 @@ Gaze following and social gaze prediction are fundamental tasks providing insigh
|
|
| 8 |
|
| 9 |
## Overview
|
| 10 |
|
| 11 |
-
* **Training**: MTGS-static-vsgaze was trained on [VSGaze](
|
| 12 |
* **Backbone**: MTGS-static-vsgaze is adapted from [MTGS-static-gazefollow](https://huggingface.co/Idiap/mtgs-static-gazefollow)
|
| 13 |
* License: [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/deed.en)
|
| 14 |
* **Parameters**: 155M
|
| 15 |
* **Task**: MTGS performs multi-person gaze following and social gaze prediction in images and videos. Given an image or a video frame with multiple people, the model predicts where each person is looking in the scene (gaze following) and infers pair-wise social gaze interactions among individuals (social gaze prediction). Specifically, we tackle three social gaze prediction tasks:
|
| 16 |
1. Looking at Heads (LAH): whether a person is looking at another person's head.
|
| 17 |
-
2. Looking at Each Other (
|
| 18 |
3. Shared Attention (SA): whether two people are looking at the same target in the scene.
|
| 19 |
* **Framework**: PyTorch Lightning
|
| 20 |
|
|
|
|
| 8 |
|
| 9 |
## Overview
|
| 10 |
|
| 11 |
+
* **Training**: MTGS-static-vsgaze was trained on [VSGaze](https://www.idiap.ch/dataset/vsgaze)
|
| 12 |
* **Backbone**: MTGS-static-vsgaze is adapted from [MTGS-static-gazefollow](https://huggingface.co/Idiap/mtgs-static-gazefollow)
|
| 13 |
* License: [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/deed.en)
|
| 14 |
* **Parameters**: 155M
|
| 15 |
* **Task**: MTGS performs multi-person gaze following and social gaze prediction in images and videos. Given an image or a video frame with multiple people, the model predicts where each person is looking in the scene (gaze following) and infers pair-wise social gaze interactions among individuals (social gaze prediction). Specifically, we tackle three social gaze prediction tasks:
|
| 16 |
1. Looking at Heads (LAH): whether a person is looking at another person's head.
|
| 17 |
+
2. Looking at Each Other (LAEO): whether two people are looking at each other.
|
| 18 |
3. Shared Attention (SA): whether two people are looking at the same target in the scene.
|
| 19 |
* **Framework**: PyTorch Lightning
|
| 20 |
|