Add robotics pipeline tag and improve model card
#1
by
nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,17 +1,39 @@
|
|
| 1 |
---
|
|
|
|
| 2 |
tags:
|
| 3 |
- RGB-D SLAM
|
| 4 |
-
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
-
|
| 10 |
-
providing both robustness against unstable camera motions and accurate reconstruction results.
|
| 11 |
|
| 12 |
-
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
-
|
| 16 |
|
| 17 |
-
|
|
|
|
| 1 |
---
|
| 2 |
+
pipeline_tag: robotics
|
| 3 |
tags:
|
| 4 |
- RGB-D SLAM
|
| 5 |
+
- dense-reconstruction
|
| 6 |
+
- camera-tracking
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimization
|
| 10 |
+
|
| 11 |
+
[ICRA 2026] PROFusion is a simple yet effective system for real-time camera tracking and dense scene reconstruction, providing both robustness against unstable camera motions and accurate reconstruction results.
|
| 12 |
+
|
| 13 |
+
This repository contains pre-trained weights for the **pose regression module**, which estimates the relative camera pose (in metric-scale) between two RGB-D frames.
|
| 14 |
+
|
| 15 |
+
- **Paper:** [PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimization](https://arxiv.org/abs/2509.24236)
|
| 16 |
+
- **Code:** [GitHub Repository](https://github.com/siyandong/PROFusion)
|
| 17 |
+
|
| 18 |
+
## Method Overview
|
| 19 |
+
|
| 20 |
+
Real-time dense scene reconstruction during unstable camera motions is crucial for robotics, yet current RGB-D SLAM systems often fail when cameras experience large viewpoint changes, fast motions, or sudden shaking. PROFusion addresses this challenge through a combination of learning-based initialization with optimization-based refinement.
|
| 21 |
+
|
| 22 |
+
The system employs a camera pose regression network to predict metric-aware relative poses from consecutive RGB-D frames, which serve as reliable starting points for a randomized optimization algorithm that further aligns depth images with the scene geometry. The system operates in real-time, showcasing that combining simple and principled techniques can achieve both robustness for unstable motions and accuracy for dense reconstruction.
|
| 23 |
+
|
| 24 |
+
## Citation
|
| 25 |
|
| 26 |
+
If you find this work helpful in your research, please consider citing:
|
|
|
|
| 27 |
|
| 28 |
+
```bibtex
|
| 29 |
+
@article{dong2025profusion,
|
| 30 |
+
title={PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimization},
|
| 31 |
+
author={Dong, Siyan and Wang, Zijun and Cai, Lulu and Ma, Yi and Yang, Yanchao},
|
| 32 |
+
journal={arXiv preprint arXiv:2509.24236},
|
| 33 |
+
year={2025}
|
| 34 |
+
}
|
| 35 |
+
```
|
| 36 |
|
| 37 |
+
## Acknowledgments
|
| 38 |
|
| 39 |
+
The implementation is based on several inspiring works in the community, including [DUSt3R](https://github.com/naver/dust3r), [SLAM3R](https://github.com/PKU-VCL-3DV/SLAM3R), [Reloc3r](https://github.com/ffrivera0/reloc3r), and [ROSEFusion](https://github.com/jzhzhang/ROSEFusion).
|