| # Preprocess Scripts | |
| Please download all datasets from their <strong>original sources</strong>, except for vKITTI, for which we provide a fully processed version—no need to download the original dataset. For MapFree and DL3DV, we also release depth maps computed using COLMAP Multi-View Stereo (MVS). See the sections below for details on the processing of each dataset. <strong>Please ensure compliance with the respective licensing agreements when downloading.</strong> The total data takes about 25TB of disk space. | |
| > If you encounter issues in the scripts, please feel free to create an issue. | |
| - [ARKitScenes](#arkitscenes) | |
| - [BlendedMVS](#blendedmvs) | |
| - [CO3Dv2](#co3d) | |
| - [MegaDepth](#megadepth) | |
| - [ScanNet++](#scannet-1) | |
| - [ScanNet](#scannet) | |
| - [WayMo Open dataset](#waymo) | |
| - [WildRGB-D](#wildrgbd) | |
| - [Map-free](#mapfree) | |
| - [TartanAir](#tartanair) | |
| - [UnrealStereo4K](#unrealstereo4k) | |
| - [Virtual KITTI 2](#virtual-kitti-2) | |
| - [3D Ken Burns](#3d-ken-burns) | |
| - [BEDLAM](#bedlam) | |
| - [COP3D](#cop3d) | |
| - [DL3DV](#dl3dv) | |
| - [Dynamic Replica](#dynamic-replica) | |
| - [EDEN](#eden) | |
| - [Hypersim](#hypersim) | |
| - [IRS](#irs) | |
| - [Matterport3D](#matterport3d) | |
| - [MVImgNet](#mvimgnet) | |
| - [MVS-Synth](#mvs-synth) | |
| - [OmniObject3D](#omniobject3d) | |
| - [PointOdyssey](#pointodyssey) | |
| - [RealEstate10K](#realestate10k) | |
| - [SmartPortraits](#smartportraits) | |
| - [Spring](#spring) | |
| - [Synscapes](#synscapes) | |
| - [UASOL](#uasol) | |
| - [UrbanSyn](#urbansyn) | |
| - [HOI4D](#hoi4d) | |
| ## [ARKitScenes](https://github.com/apple/ARKitScenes) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| First download the pre-computed pairs provided by [DUSt3R](https://download.europe.naverlabs.com/ComputerVision/DUSt3R/arkitscenes_pairs.zip). | |
| Then run the following command, | |
| ``` | |
| python preprocess_arkitscenes.py --arkitscenes_dir /path/to/your/raw/data --precomputed_pairs /path/to/your/pairs --output_dir /path/to/your/outdir | |
| python generate_set_arkitscenes.py --root /path/to/your/outdir --splits Training Test --max_interval 5.0 --num_workers 8 | |
| ``` | |
| ## [ARKitScenes_highres](https://github.com/apple/ARKitScenes) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| This dataset is a subset of ARKitScenes with high resolution depthmaps. | |
| ``` | |
| python preprocess_arkitscenes_highres.py --arkitscenes_dir /path/to/your/raw/data --output_dir /path/to/your/outdir | |
| ``` | |
| ## [BlendedMVS](https://github.com/YoYo000/BlendedMVS) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| Follow DUSt3R to generate the processed BlendedMVS data: | |
| ``` | |
| python preprocess_blendedmvs.py --blendedmvs_dir /path/to/your/raw/data --precomputed_pairs /path/to/your/pairs --output_dir /path/to/your/outdir | |
| ``` | |
| Then put our [overlap set](https://drive.google.com/file/d/1anBQhF9BgOvgaWgAwWnf70tzspQZHBBB/view?usp=sharing) under `/path/to/your/outdir`. | |
| ## [CO3D](https://github.com/facebookresearch/co3d) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| Follow DUSt3R to generate the processed CO3D data. | |
| ``` | |
| python3 preprocess_co3d.py --co3d_dir /path/to/your/raw/data --output_dir /path/to/your/outdir | |
| ``` | |
| ## [MegaDepth](https://www.cs.cornell.edu/projects/megadepth/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| First download our [precomputed set](https://drive.google.com/file/d/1bU1VqRu1NdW-4J4BQybqQS64mUG1EtF1/view?usp=sharing) under `/path/to/your/outdir`. | |
| Then run | |
| ``` | |
| python preprocess_megadepth.py --megadepth_dir /path/to/your/raw/data --precomputed_sets /path/to/precomputed_sets --output_dir /path/to/your/outdir | |
| ``` | |
| ## [Scannet](http://www.scan-net.org/ScanNet/) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_scannet.py --scannet_dir /path/to/your/raw/data --output_dir /path/to/your/outdir | |
| python generate_set_scannet.py --root /path/to/your/outdir \ | |
| --splits scans_test scans_train --max_interval 150 --num_workers 8 | |
| ``` | |
| ## [Scannet++](https://kaldir.vc.in.tum.de/scannetpp/) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| First download the pre-computed pairs provided by [DUSt3R](https://download.europe.naverlabs.com/ComputerVision/DUSt3R/scannetpp_pairs.zip). | |
| Then run the following command, | |
| ``` | |
| python preprocess_scannetpp.py --scannetpp_dir /path/to/your/raw/data --precomputed_pairs /path/to/your/pairs --output_dir /path/to/your/outdir | |
| python generate_set_scannetpp.py --root /path/to/your/outdir \ | |
| --max_interval 150 --num_workers 8 | |
| ``` | |
| ## [Waymo](https://github.com/waymo-research/waymo-open-dataset) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| Follow DUSt3R to generate the processed Waymo data. | |
| ``` | |
| python3 preprocess_waymo.py --waymo_dir /path/to/your/raw/data -precomputed_pairs /path/to/precomputed_pairs --output_dir /path/to/your/outdir | |
| ``` | |
| Then download our [invalid_files](https://drive.google.com/file/d/1xI2SHHoXw1Bm7Lqrn7v56x30stCNuhlv/view?usp=sharing) and put it under `/path/to/your/outdir`. | |
| ## [WildRGBD](https://github.com/wildrgbd/wildrgbd/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| Follow DUSt3R to generate the processed WildRGBD data. | |
| ``` | |
| python3 preprocess_wildrgbd.py --wildrgbd_dir /path/to/your/raw/data --output_dir /path/to/your/outdir | |
| ``` | |
| ## [Mapfree](https://research.nianticlabs.com/mapfree-reloc-benchmark/dataset) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!--<img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| First preprocess the colmap results provided by Mapfree: | |
| ``` | |
| python3 preprocess_mapfree.py --mapfree_dir /path/to/train/data --colmap_dir /path/to/colmap/data --output_dir /path/to/first/outdir | |
| ``` | |
| Then re-organize the data structure: | |
| ``` | |
| python3 preprocess_mapfree2.py --mapfree_dir /path/to/first/outdir --output_dir /path/to/final/outdir | |
| ``` | |
| Finally, download our released [depths and masks](https://drive.google.com/file/d/1gJGEAV5e08CR6nK2gH9i71a7_WJ4ANwc/view?usp=drive_link) and combine it with your `/path/to/final/outdir`. | |
| ``` | |
| rsync -av --update /path/to/our/release /path/to/final/outdir | |
| ``` | |
| ## [TartanAir](https://theairlab.org/tartanair-dataset/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!--<img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python3 preprocess_tartanair.py --tartanair_dir /path/to/your/raw/data --output_dir /path/to/your/outdir | |
| ``` | |
| ## [UnrealStereo4K](https://github.com/fabiotosi92/SMD-Nets) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!--<img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python3 preprocess_unreal4k.py --unreal4k_dir /path/to/your/raw/data --output_dir /path/to/your/outdir | |
| ``` | |
| ## [Virtual KITTI 2](https://europe.naverlabs.com/research/computer-vision/proxy-virtual-worlds-vkitti-2/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!--<img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| As Virtual KITTI 2 is using CC BY-NC-SA 3.0 License, we directly release our [preprocessed data](https://drive.google.com/file/d/1KdAH4ztRkzss1HCkGrPjQNnMg5c-f3aD/view?usp=sharing). | |
| ## [3D Ken Burns](https://github.com/sniklaus/3d-ken-burns.git) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_3dkb.py --root /path/to/data_3d_ken_burns \ | |
| --out_dir /path/to/processed_3dkb \ | |
| [--num_workers 4] [--seed 42] | |
| ``` | |
| ## [BEDLAM](https://bedlam.is.tue.mpg.de/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_bedlam.py --root /path/to/extracted_data \ | |
| --outdir /path/to/processed_bedlam \ | |
| [--num_workers 4] | |
| ``` | |
| ## [COP3D](https://github.com/facebookresearch/cop3d) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python3 preprocess_cop3d.py --cop3d_dir /path/to/cop3d \ | |
| --output_dir /path/to/processed_cop3d | |
| ``` | |
| ## [DL3DV](https://github.com/DL3DV-10K/Dataset) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ~~Due to current potential problems with license, you may need to run multi-view stereo on DL3DV by yourself (which is extremely time consuming). If this is done, then you can use our preprocess script:~~ | |
| ~~```~~ | |
| ~~python3 preprocess_dl3dv.py --dl3dv_dir /path/to/dl3dv \ | |
| --output_dir /path/to/processed_dl3dv~~ | |
| ~~```~~ | |
| **Update: We've released the full version of our processed DL3DV dataset!** | |
| To use our processed DL3DV data, please ensure that you **first** cite the [original DL3DV work](https://github.com/DL3DV-10K/Dataset) and adhere to their licensing terms. | |
| You can then download the following components: | |
| - [RGB images and camera parameters](https://huggingface.co/datasets/zhangify/CUT3R_release/tree/main/processed_dl3dv_ours_rgb_cam_1) | |
| - [Depthmaps and masks](https://drive.google.com/file/d/14E15EG5NJgWH5UVYubrPSSFXmReCIe7f/view?usp=drive_link) | |
| After downloading, merge the components using the provided script: | |
| ``` | |
| python3 merge_dl3dv.py # remember to change necessary paths | |
| ``` | |
| ## [Dynamic Replica](https://github.com/facebookresearch/dynamic_stereo) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_dynamic_replica.py --root_dir /path/to/data_dynamic_replica \ | |
| --out_dir /path/to/processed_dynamic_replica | |
| ``` | |
| ## [EDEN](https://lhoangan.github.io/eden/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!--<img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_eden.py --root /path/to/data_raw_videos/data_eden \ | |
| --out_dir /path/to/data_raw_videos/processed_eden \ | |
| [--num_workers N] | |
| ``` | |
| ## [Hypersim](https://github.com/apple/ml-hypersim) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_hypersim.py --hypersim_dir /path/to/hypersim \ | |
| --output_dir /path/to/processed_hypersim | |
| ``` | |
| ## [IRS](https://github.com/HKBU-HPML/IRS) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_irs.py | |
| --root_dir /path/to/data_irs | |
| --out_dir /path/to/processed_irs | |
| ``` | |
| ## [Matterport3D](https://niessner.github.io/Matterport/) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_mp3d.py --root_dir /path/to/data_mp3d/v1/scans \ | |
| --out_dir /path/to/processed_mp3d | |
| ``` | |
| ## [MVImgNet](https://github.com/GAP-LAB-CUHK-SZ/MVImgNet) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <!--<img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_mvimgnet.py --data_dir /path/to/MVImgNet_data \ | |
| --pcd_dir /path/to/MVPNet \ | |
| --output_dir /path/to/processed_mvimgnet | |
| ``` | |
| ## [MVS-Synth](https://phuang17.github.io/DeepMVS/mvs-synth.html) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_mvs_synth.py --root_dir /path/to/data_mvs_synth/GTAV_720/ \ | |
| --out_dir /path/to/processed_mvs_synth \ | |
| --num_workers 32 | |
| ``` | |
| ## [OmniObject3D](https://omniobject3d.github.io/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_omniobject3d.py --input_dir /path/to/input_root --output_dir /path/to/output_root | |
| ``` | |
| ## [PointOdyssey](https://pointodyssey.com/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_point_odyssey.py --input_dir /path/to/input_dataset --output_dir /path/to/output_dataset | |
| ``` | |
| ## [RealEstate10K](https://google.github.io/realestate10k/) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/METRIC-red | |
| " style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_re10k.py --root_dir /path/to/train \ | |
| --info_dir /path/to/RealEstate10K/train \ | |
| --out_dir /path/to/processed_re10k | |
| ``` | |
| ## [SmartPortraits](https://mobileroboticsskoltech.github.io/SmartPortraits/) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <br> | |
| </div> | |
| You need to follow the [official processing pipeline](https://github.com/MobileRoboticsSkoltech/SmartPortraits-toolkit) first. Replace the `convert_to_TUM/utils/convert_to_tum.py` with our `datasets_preprocess/custom_convert2TUM.py` (You may need to change the input path and output path). | |
| Then run | |
| ``` | |
| python preprocess_smartportraits.py \ | |
| --input_dir /path/to/official/pipeline/output \ | |
| --output_dir /path/to/processed_smartportraits | |
| ``` | |
| ## [Spring](https://spring-benchmark.org/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!--<img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_spring.py \ | |
| --root_dir /path/to/spring/train \ | |
| --out_dir /path/to/processed_spring \ | |
| --baseline 0.065 \ | |
| --output_size 960 540 | |
| ``` | |
| ## [Synscapes](https://synscapes.on.liu.se/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_synscapes.py \ | |
| --synscapes_dir /path/to/Synscapes/Synscapes \ | |
| --output_dir /path/to/processed_synscapes | |
| ``` | |
| ## [UASOL](https://osf.io/64532/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_uasol.py \ | |
| --input_dir /path/to/data_uasol \ | |
| --output_dir /path/to/processed_uasol | |
| ``` | |
| ## [UrbanSyn](https://www.urbansyn.org/) | |
| <div> | |
| <!-- <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/>--> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_urbansyn.py \ | |
| --input_dir /path/to/data_urbansyn \ | |
| --output_dir /path/to/processed_urbansyn | |
| ``` | |
| ## [HOI4D](https://hoi4d.github.io/) | |
| <div> | |
| <img src="https://img.shields.io/badge/INDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/MIXED-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/OUTDOOR-blue" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/ObjectCentric-blue" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/METRIC-red" style="display: inline-block; vertical-align: middle;"/> | |
| <img src="https://img.shields.io/badge/RealWorld-orange" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Synthetic-orange" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/Dynamic-green" style="display: inline-block; vertical-align: middle;"/> | |
| <!-- <img src="https://img.shields.io/badge/Static-green" style="display: inline-block; vertical-align: middle;"/> --> | |
| <!-- <img src="https://img.shields.io/badge/CameraOnly-crimson" style="display: inline-block; vertical-align: middle;"/> --> | |
| <img src="https://img.shields.io/badge/SingleView-crimson" style="display: inline-block; vertical-align: middle;"/> | |
| <br> | |
| </div> | |
| ``` | |
| python preprocess_hoi4d.py \ | |
| --root_dir /path/to/HOI4D_release \ | |
| --cam_root /path/to/camera_params \ | |
| --out_dir /path/to/processed_hoi4d | |
| ``` | |