anhquancao nielsr HF Staff commited on
Commit
a3772d8
·
1 Parent(s): 58d6c5a

Add model card for OccAny (#1)

Browse files

- Add model card for OccAny (f4ba818f44f72e3e80dfbb57bd10c3b4c4b67646)


Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +75 -0
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: image-to-3d
4
+ tags:
5
+ - 3d-occupancy
6
+ - autonomous-driving
7
+ - computer-vision
8
+ ---
9
+
10
+ # OccAny: Generalized Unconstrained Urban 3D Occupancy
11
+
12
+ OccAny is a unified framework for generalized unconstrained urban 3D occupancy prediction. It is the first unconstrained urban 3D occupancy model capable of operating on out-of-domain uncalibrated scenes to predict and complete metric occupancy coupled with segmentation features from sequential, monocular, or surround-view images.
13
+
14
+ - **Paper:** [OccAny: Generalized Unconstrained Urban 3D Occupancy](https://huggingface.co/papers/2603.23502)
15
+ - **Project Page:** [https://valeoai.github.io/OccAny](https://valeoai.github.io/OccAny)
16
+ - **Code:** [https://github.com/valeoai/OccAny](https://github.com/valeoai/OccAny)
17
+
18
+ ## Model Variants
19
+
20
+ This repository hosts checkpoints for two model variants:
21
+ - **OccAny**: Based on Must3R and SAM2.
22
+ - **OccAny+**: Based on Depth Anything 3 and SAM3.
23
+
24
+ ## Sample Usage
25
+
26
+ After following the installation instructions in the [GitHub repository](https://github.com/valeoai/OccAny), you can run inference using the following commands.
27
+
28
+ ### OccAny+ (Depth Anything 3 + SAM3)
29
+ ```bash
30
+ python inference.py \
31
+ --batch_gen_view 2 \
32
+ --view_batch_size 2 \
33
+ --semantic distill@SAM3 \
34
+ --compute_segmentation_masks \
35
+ --gen \
36
+ -rot 30 \
37
+ -vpi 2 \
38
+ -fwd 5 \
39
+ --seed_translation_distance 2 \
40
+ --recon_conf_thres 2.0 \
41
+ --gen_conf_thres 6.0 \
42
+ --apply_majority_pooling \
43
+ --model occany_da3
44
+ ```
45
+
46
+ ### OccAny (Must3R + SAM2)
47
+ ```bash
48
+ python inference.py \
49
+ --batch_gen_view 2 \
50
+ --view_batch_size 2 \
51
+ --semantic distill@SAM2_large \
52
+ --compute_segmentation_masks \
53
+ --gen \
54
+ -rot 30 \
55
+ -vpi 2 \
56
+ -fwd 5 \
57
+ --seed_translation_distance 2 \
58
+ --recon_conf_thres 2.0 \
59
+ --gen_conf_thres 2.0 \
60
+ --apply_majority_pooling \
61
+ --model occany_must3r
62
+ ```
63
+
64
+ ## Citation
65
+
66
+ If you find this work or code useful, please cite the paper:
67
+
68
+ ```bibtex
69
+ @inproceedings{cao2026occany,
70
+ title={OccAny: Generalized Unconstrained Urban 3D Occupancy},
71
+ author={Anh-Quan Cao and Tuan-Hung Vu},
72
+ booktitle={CVPR},
73
+ year={2026}
74
+ }
75
+ ```