| ## Env | |
| ### Use Docker | |
| The docker image: `nvidia/pytorch:23.07-py3` | |
| ```shell | |
| alias=`whoami | cut -d'.' -f2` | |
| docker run -itd --runtime=nvidia --ipc=host --privileged --network host -v /home/${alias}:/home/${alias} -w `pwd` --name sca nvcr.io/nvidia/pytorch:23.07-py3 bash | |
| # Maybe we need this version for evaluation | |
| # docker run -itd --runtime=nvidia --ipc=host --privileged --network host -v /home/${alias}:/home/${alias} -w `pwd` --name sca nvcr.io/nvidia/pytorch:22.10-py3 bash | |
| docker exec -it sca bash | |
| # In the docker container | |
| # cd to the code dir | |
| . amlt_configs/setup.sh | |
| ``` | |
| ### Use Conda | |
| ```shell | |
| conda create -n sca-v2 -y python=3.9 | |
| conda activate sca-v2 | |
| # https://pytorch.org/, pytorch 2.0.1 (as of 07/12/2023) | |
| conda install pytorch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2 pytorch-cuda=11.8 -c pytorch -c nvidia | |
| pip install -r requirements.txt | |
| pip install -U datasets==2.16.1 # NotImplementedError(f"Loading a dataset cached in a {type(self._fs).__name__} is not supported.") https://github.com/huggingface/datasets/issues/6352 | |
| ``` | |
| For dev | |
| ```shell | |
| mkdir -p tmp/{data,code} | |
| pip install -r requirements-dev.txt | |
| ``` | |
| For gradio demo: | |
| ``` | |
| pip install -r requirements-app.txt | |
| ``` | |
| `transformers` is based on v4.30.2, hash 66fd3a8d6 | |
| ```shell | |
| REPO_DIR=transformers | |
| git clone git@github.com:huggingface/transformers.git $REPO_DIR | |
| git fetch --all --tags --prune | |
| git checkout v4.30.2 -b v4.30.2 | |
| git rev-parse --short HEAD | |
| ``` | |
| ## Data | |
| Replace the data file paths in `src/conf/data/*.yaml`. | |
| The data file links: | |
| - VG: https://homes.cs.washington.edu/~ranjay/visualgenome/index.html | |
| - COCO: https://cocodataset.org/ | |
| - Objects365: https://www.objects365.org/ | |
| - V3Det: https://v3det.openxlab.org.cn/ |