Commit ·
a3772d8
1
Parent(s): 58d6c5a
Add model card for OccAny (#1)
Browse files- Add model card for OccAny (f4ba818f44f72e3e80dfbb57bd10c3b4c4b67646)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: image-to-3d
|
| 4 |
+
tags:
|
| 5 |
+
- 3d-occupancy
|
| 6 |
+
- autonomous-driving
|
| 7 |
+
- computer-vision
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# OccAny: Generalized Unconstrained Urban 3D Occupancy
|
| 11 |
+
|
| 12 |
+
OccAny is a unified framework for generalized unconstrained urban 3D occupancy prediction. It is the first unconstrained urban 3D occupancy model capable of operating on out-of-domain uncalibrated scenes to predict and complete metric occupancy coupled with segmentation features from sequential, monocular, or surround-view images.
|
| 13 |
+
|
| 14 |
+
- **Paper:** [OccAny: Generalized Unconstrained Urban 3D Occupancy](https://huggingface.co/papers/2603.23502)
|
| 15 |
+
- **Project Page:** [https://valeoai.github.io/OccAny](https://valeoai.github.io/OccAny)
|
| 16 |
+
- **Code:** [https://github.com/valeoai/OccAny](https://github.com/valeoai/OccAny)
|
| 17 |
+
|
| 18 |
+
## Model Variants
|
| 19 |
+
|
| 20 |
+
This repository hosts checkpoints for two model variants:
|
| 21 |
+
- **OccAny**: Based on Must3R and SAM2.
|
| 22 |
+
- **OccAny+**: Based on Depth Anything 3 and SAM3.
|
| 23 |
+
|
| 24 |
+
## Sample Usage
|
| 25 |
+
|
| 26 |
+
After following the installation instructions in the [GitHub repository](https://github.com/valeoai/OccAny), you can run inference using the following commands.
|
| 27 |
+
|
| 28 |
+
### OccAny+ (Depth Anything 3 + SAM3)
|
| 29 |
+
```bash
|
| 30 |
+
python inference.py \
|
| 31 |
+
--batch_gen_view 2 \
|
| 32 |
+
--view_batch_size 2 \
|
| 33 |
+
--semantic distill@SAM3 \
|
| 34 |
+
--compute_segmentation_masks \
|
| 35 |
+
--gen \
|
| 36 |
+
-rot 30 \
|
| 37 |
+
-vpi 2 \
|
| 38 |
+
-fwd 5 \
|
| 39 |
+
--seed_translation_distance 2 \
|
| 40 |
+
--recon_conf_thres 2.0 \
|
| 41 |
+
--gen_conf_thres 6.0 \
|
| 42 |
+
--apply_majority_pooling \
|
| 43 |
+
--model occany_da3
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
### OccAny (Must3R + SAM2)
|
| 47 |
+
```bash
|
| 48 |
+
python inference.py \
|
| 49 |
+
--batch_gen_view 2 \
|
| 50 |
+
--view_batch_size 2 \
|
| 51 |
+
--semantic distill@SAM2_large \
|
| 52 |
+
--compute_segmentation_masks \
|
| 53 |
+
--gen \
|
| 54 |
+
-rot 30 \
|
| 55 |
+
-vpi 2 \
|
| 56 |
+
-fwd 5 \
|
| 57 |
+
--seed_translation_distance 2 \
|
| 58 |
+
--recon_conf_thres 2.0 \
|
| 59 |
+
--gen_conf_thres 2.0 \
|
| 60 |
+
--apply_majority_pooling \
|
| 61 |
+
--model occany_must3r
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
## Citation
|
| 65 |
+
|
| 66 |
+
If you find this work or code useful, please cite the paper:
|
| 67 |
+
|
| 68 |
+
```bibtex
|
| 69 |
+
@inproceedings{cao2026occany,
|
| 70 |
+
title={OccAny: Generalized Unconstrained Urban 3D Occupancy},
|
| 71 |
+
author={Anh-Quan Cao and Tuan-Hung Vu},
|
| 72 |
+
booktitle={CVPR},
|
| 73 |
+
year={2026}
|
| 74 |
+
}
|
| 75 |
+
```
|