README.md

---
tags:
- Indoor-localization
- 6d-pose-estimation
- scene-understanding
language:
- en
---
<div align="center">

<h1>SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments</h1>

<div>
    ECCV 2024
</div>

<div>
    <a href='https://iphome.hhi.de/gard/index.htm' target='_blank'>Niklas Gard<sup>1,2</sup></a>&emsp;
    <a href='https://iphome.hhi.de/hilsmann/index.htm' target='_blank'>Anna Hilsmann<sup>1</sup></a>&emsp;
    <a href='https://iphome.hhi.de/eisert/index.htm' target='_blank'>Peter Eisert<sup>1,2</sup></a>&emsp;
</div>
<div>
    Fraunhofer Heinrich Hertz Institute, HHI<sup>1</sup>, Humboldt University of Berlin<sup>2</sup>
</div>
<h2>
  <a href="https://fraunhoferhhi.github.io/spvloc/">🌐 Project Page</a>
  &nbsp;|&nbsp;
  <a href="https://arxiv.org/abs/2404.10527">📄 Paper</a>
  &nbsp;|&nbsp;
  <a href="https://eccv.ecva.net/media/PosterPDFs/ECCV%202024/515.png">🖼️ Poster</a>
  &nbsp;|&nbsp;
  <a href="https://github.com/fraunhoferhhi/spvloc">🐙 Github</a>
  &nbsp;|&nbsp;
  <a href="https://github.com/fraunhoferhhi/spvloc#-quick-demo">🚀 Demo</a>
</h2>

</div>

**SPVLoc** estimates the **indoor 6D camera pose** by determining the image position and orientation relative to a **minimalistic, semantically annotated 3D model**. 
This model is represented by a set of synthetic panoramic images, from which the method identifies the optimal panoramic match using semantic viewport matching. 
Finally, the 6D pose is estimated relative to the location of the best-matching panorama.

![teaser.png](https://cdn-uploads.huggingface.co/production/uploads/6579cde2691da91ece77657d/0t7dz1TyVJrMpq9RsSqcW.png)

# 🚀 Quick Demo
Check out our code and demo at [github](https://github.com/fraunhoferhhi/spvloc).

![gui.gif](https://cdn-uploads.huggingface.co/production/uploads/6579cde2691da91ece77657d/wjzT0S0NV4-HHrK9JPeAw.gif)

## 📚 Citation

If you find this code or our method useful for your academic research, please cite our paper

```bibtex
@inproceedings{gard2024spvloc,
 title        = {SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments},
 author       = {Niklas Gard and Anna Hilsmann and Peter Eisert},
 year         = 2024,
 booktitle    = {Computer Vision -- {ECCV} 2024: 18th European Conference on Computer Vision, Proceedings, Part LXXIII},
 publisher    = {Springer Nature Switzerland},
 address      = {Cham},
 pages        = {398--415},
 doi          = {10.1007/978-3-031-73464-9_24},
 url          = {https://fraunhoferhhi.github.io/spvloc/}
}

```