|
Download README.md from apple/DepthPro2-S: direct link, hf CLI and curl.
- Browser
- Download file 3.78 kB
-
https://huggingface.co/apple/DepthPro2-S/resolve/main/README.md
- Command line
-
hf download hf://apple/DepthPro2-S/README.md
-
curl -L -o README.md https://huggingface.co/apple/DepthPro2-S/resolve/main/README.md
3.78 kB
| license: other | |
| license_name: apple-amlr | |
| license_link: https://github.com/apple-aiml-research/ml-depth-pro-2/blob/main/LICENSE_MODEL | |
| pipeline_tag: depth-estimation | |
| library_name: depth-pro-2 | |
| tags: | |
| - depth-estimation | |
| - metric-depth | |
| - monocular-depth | |
| - video-depth | |
| <h1 align="center">Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth</h1> | |
| <p align="center"> | |
| <a href="https://github.com/apple-aiml-research/ml-depth-pro-2"><img src="https://img.shields.io/badge/GitHub-181717?style=flat-square&logo=github&logoColor=white" alt="GitHub"/></a> | |
| <a href="https://arxiv.org/abs/2611.26603"><img src="https://img.shields.io/badge/Technical%20Report-B31B1B?style=flat-square&logo=arxiv&logoColor=white" alt="Technical Report"/></a> | |
| <a href="https://apple-aiml-research.github.io/ml-depth-pro-2/"><img src="https://img.shields.io/badge/Project%20Page-666666?style=flat-square&logo=data%3Aimage%2Fsvg%2Bxml%3Bbase64%2CPHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHZpZXdCb3g9IjAgMCAyNCAyNCIgZmlsbD0ibm9uZSIgc3Ryb2tlPSJ3aGl0ZSIgc3Ryb2tlLXdpZHRoPSIyIj48Y2lyY2xlIGN4PSIxMiIgY3k9IjEyIiByPSIxMCIvPjxwYXRoIGQ9Ik0yIDEyaDIwTTEyIDJhMTUgMTUgMCAwIDEgMCAyME0xMiAyYTE1IDE1IDAgMCAwIDAgMjAiLz48L3N2Zz4%3D" alt="Project Page"/></a> | |
| <a href="https://huggingface.co/apple/DepthPro2"><img src="https://img.shields.io/badge/All%20Sizes-FFD21E?style=flat-square&logo=huggingface&logoColor=black" alt="All Sizes"/></a> | |
| </p> | |
| <h3 align="center">Model size S · 24M parameters</h3> | |
| <!-- Hidden until the Space is public: | |
| <h3 align="center"> | |
| 🚀 <a href="https://huggingface.co/spaces/apple/DepthPro2">Try the Interactive Demo →</a> | |
| </h3> | |
| --> | |
| | B200 | VGA | 720p | 1080p | 4K | | |
| |:---|:---:|:---:|:---:|:---:| | |
| | Throughput (fps) | 347.0 | 143.9 | 44.8 | 3.6 | | |
| | Peak memory (GiB) | 1.9 | 3.8 | 8.0 | 31.9 | | |
| <details> | |
| <summary>Benchmark details</summary> | |
| - **GPU:** NVIDIA B200, in bfloat16 and PyTorch eager mode (no compilation) | |
| - **Input:** a 32-frame video clip, processed in one call at its native resolution | |
| - **Resolutions:** VGA is 640 × 480; 720p, 1080p and 4K are 16:9 | |
| - **Throughput:** frames per second, averaged over the clip | |
| - **Memory:** the peak GPU memory PyTorch reserves | |
| - **Included:** the [focal length estimator](https://huggingface.co/apple/DepthPro2-focal), a separate 23.5M-parameter model that loads with the depth model | |
| </details> | |
| ## How to use | |
| ```bash | |
| pip install "git+https://github.com/apple-aiml-research/ml-depth-pro-2" | |
| ``` | |
| ```python | |
| from functools import partial | |
| import torch | |
| from depth_pro_2 import DepthPro2, load_rgb | |
| from depth_pro_2.model import to_normalized_tensor | |
| model = DepthPro2.from_pretrained("apple/DepthPro2-S", precision=torch.bfloat16) | |
| model = model.to("cuda") | |
| transform = partial(to_normalized_tensor, device=torch.device("cuda")) | |
| image, f_px = load_rgb("photo.jpg") # f_px: EXIF focal length, or None | |
| depth = model.infer(transform(image), f_px=f_px)["depth"] # meters, (H, W) | |
| ``` | |
| Videos, the other sizes and the command line are on the | |
| [Depth Pro 2 page](https://huggingface.co/apple/DepthPro2). | |
| ## License | |
| The weights are released under the [Apple Machine Learning Research Model license](https://github.com/apple-aiml-research/ml-depth-pro-2/blob/main/LICENSE_MODEL), for | |
| research use only: non-commercial scientific research and academic development. | |
| ## Citation | |
| ```bibtex | |
| @article{DepthPro2:2026:arxiv, | |
| title = {Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth}, | |
| author = {Peiyun Hu and Marko Mihajlovic and Lyndon Duong and Lahav Lipson and Wei Dong and Ama\"{e}l Delaunoy and Stephan R. Richter and Vladlen Koltun}, | |
| journal = {arXiv preprint arXiv:2611.26603}, | |
| year = {2026}, | |
| url = {https://arxiv.org/abs/2611.26603}, | |
| } | |
| ``` | |