tools/data/multisports/README.md

Preparing Multisports

Introduction

@inproceedings{li2021multisports,
  title={Multisports: A multi-person video dataset of spatio-temporally localized sports actions},
  author={Li, Yixuan and Chen, Lei and He, Runyu and Wang, Zhenzhi and Wu, Gangshan and Wang, Limin},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={13536--13545},
  year={2021}
}

For basic dataset information, please refer to the official project and the paper. Before we start, please make sure that the directory is located at $MMACTION2/tools/data/multisports/.

Step 1. Prepare Annotations

First of all, you have to download annotations and videos to $MMACTION2/data/multisports on the official website, please also download the Person Boxes and put it to $MMACTION2/data/multisports.

Step 2. Prepare Videos

Before this step, please make sure the folder structure looks like:

mmaction2
├── mmaction
├── tools
├── configs
├── data
│   ├── multisports
│   |   ├── MultiSports_box.zip
│   |   ├── trainval
│   |   |   ├── aerobic_gymnastics.zip
│   |   |   ├── basketball.zip
│   |   |   ├── multisports_GT.pkl
│   |   |   ├──...
│   |   ├── test
│   |   |   ├── aerobic_gymnastics.zip
│   |   |   ├── basketball.zip
│   |   |   ├──...

Then, you can use the following command to uncompress.

cd $MMACTION2/data/multisports/
unzip MultiSports_box.zip
cd $MMACTION2/data/multisports/trainval
find . -name '*.zip' -exec unzip {} \;
cd $MMACTION2/data/multisports/test
find . -name '*.zip' -exec unzip {} \;
cd $MMACTION2/tools/data/multisports/

Step 3. Convert Annotations

you can run the following script to convert annotations and proposals as we need.

cd $MMACTION2/tools/data/multisports/
python parse_anno.py

Step 5. Check Directory Structure

After the whole data process, you will get the videos and annotation files for MultiSports.

In the context of the whole project (for MultiSports only), the folder structure will look like:

mmaction2
├── mmaction
├── tools
├── configs
├── data
│   ├── multisports
│   |   ├── annotations
|   │   |   ├── multisports_dense_proposals_test.recall_96.13.pkl
|   │   |   ├── multisports_dense_proposals_train.recall_96.13.pkl
|   │   |   ├── multisports_dense_proposals_val.recall_96.13.pkl
|   │   |   ├── multisports_GT.pkl
|   │   |   ├── multisports_train.csv
|   │   |   ├── multisports_val.csv
│   |   ├── trainval
│   |   |   ├── aerobic_gymnastics
|   │   |   |   ├── v__wAgwttPYaQ_c001.mp4
|   │   |   |   ├── v__wAgwttPYaQ_c002.mp4
|   │   |   |   ├── ...
│   |   |   ├── basketball
|   │   |   |   ├── v_-6Os86HzwCs_c001.mp4
|   │   |   |   ├── v_-6Os86HzwCs_c002.mp4
|   │   |   |   ├── ...
│   |   |   ├── multisports_GT.pkl
│   |   |   ├──...
│   |   ├── test
│   |   |   ├── aerobic_gymnastics
|   │   |   |   ├── v_2KroSzspz-c_c001.mp4
|   │   |   |   ├── v_2KroSzspz-c_c002.mp4
|   │   |   |   ├── ...
│   |   |   ├── basketball
|   │   |   |   ├── v_1tefH1iPbGM_c001.mp4
|   │   |   |   ├── v_1tefH1iPbGM_c002.mp4
│   |   |   ├──...

We don't need the zip files under the project, you can handle them as you want. For training and evaluating on MultiSports, please refer to Training and Test Tutorial.