Update README.md
Browse files
README.md
CHANGED
|
@@ -1,9 +1,11 @@
|
|
| 1 |
-
---
|
| 2 |
-
{}
|
| 3 |
-
---
|
| 4 |
-
|
| 5 |
|
| 6 |
-
|
|
|
|
|
|
|
| 7 |
|
| 8 |
This model is ready for non-commercial use. <br>
|
| 9 |
|
|
|
|
| 1 |
+
---
|
| 2 |
+
{}
|
| 3 |
+
---
|
| 4 |
+
# NVPanoptix-3D
|
| 5 |
|
| 6 |
+
## Description
|
| 7 |
+
|
| 8 |
+
NVPanoptix-3D is a 3D Panoptic Reconstruction model that reconstructs complete 3D indoor scenes from single RGB images, simultaneously performing 2D panoptic segmentation, depth estimation, 3D scene reconstruction, and 3D panoptic segmentation. Built upon Uni-3D (ICCV 2023) baseline architecture, this model enhances 3D understanding by replacing the backbone with VGGT (Visual Geometry Grounded Transformer) and integrating multi-plane occupancy-aware lifting from BUOL (CVPR 2023) for improved 3D scene re-projection. The model reconstructs complete 3D scenes with both object instances (things) and scene layout (stuff) in a unified framework. <br>
|
| 9 |
|
| 10 |
This model is ready for non-commercial use. <br>
|
| 11 |
|