Commit ·
3589e02
1
Parent(s): 9bd3eef
Add model card and pipeline metadata (#1)
Browse files- Add model card and pipeline metadata (e415929e40312a89b3c6dfc3a485bc71cf23ecca)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -1,3 +1,67 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
pipeline_tag: other
|
| 4 |
---
|
| 5 |
+
|
| 6 |
+
# TrajLoc: Trajectory-aware Cross-view Geo-localization with Sequential Observations
|
| 7 |
+
|
| 8 |
+
[🏠 Project Page](https://humblegamer.github.io/trajloc/) | [📖 Paper](https://arxiv.org/abs/2607.15491) | [💻 GitHub](https://github.com/mvrl/TrajLoc) | [📊 SeqGeo-VL Dataset](https://huggingface.co/datasets/jiayulin/SeqGeo-VL)
|
| 9 |
+
|
| 10 |
+
This repository contains the pre-trained weights for **TrajLoc**, presented at ECCV 2026.
|
| 11 |
+
|
| 12 |
+
TrajLoc is a unified framework for cross-view geo-localization that localizes a *trajectory* instead of a single ground image. Given a street-view video sequence, a natural-language route description, or both, it retrieves the matching geo-tagged satellite tile.
|
| 13 |
+
|
| 14 |
+
<p align="center">
|
| 15 |
+
<img src="https://raw.githubusercontent.com/mvrl/TrajLoc/main/assets/teaser.png" width="85%" alt="TrajLoc concept teaser"/>
|
| 16 |
+
</p>
|
| 17 |
+
|
| 18 |
+
## Highlights
|
| 19 |
+
- **Unified Multi-modal Query**: Supports querying with video frames, plain-language route descriptions, or a blend of both.
|
| 20 |
+
- **Spatially-grounded Embeddings**: Integrates **TrajMod**, a lightweight module that maps route geometry to modulate query embeddings for spatially-aware representations.
|
| 21 |
+
- **Agentic Tool Interface**: Includes a function-calling tool interface so multimodal agents can easily localize routes as part of broader spatial reasoning.
|
| 22 |
+
|
| 23 |
+
---
|
| 24 |
+
|
| 25 |
+
## Quickstart & Usage
|
| 26 |
+
|
| 27 |
+
Please refer to the official [TrajLoc GitHub repository](https://github.com/mvrl/TrajLoc) for installation instructions and dependencies.
|
| 28 |
+
|
| 29 |
+
### Python API Example
|
| 30 |
+
|
| 31 |
+
You can use the model as a tool for trajectory localization:
|
| 32 |
+
|
| 33 |
+
```python
|
| 34 |
+
from trajloc_tool import TrajLocTool
|
| 35 |
+
|
| 36 |
+
# Initialize the tool with the pretrained checkpoint
|
| 37 |
+
tool = TrajLocTool(
|
| 38 |
+
checkpoint_path="checkpoints/trajloc_full.pth",
|
| 39 |
+
gallery_manifest="gallery.json", # satellite tiles to search over
|
| 40 |
+
gallery_cache="gallery_features.pt", # features cached here after the first run
|
| 41 |
+
)
|
| 42 |
+
|
| 43 |
+
# Localize a trajectory using a text-based route description
|
| 44 |
+
result = tool.localize_trajectory(
|
| 45 |
+
query_mode="text",
|
| 46 |
+
text="The route heads east along a tree-lined street, then turns right at the church.",
|
| 47 |
+
traj_coords=[[38.6488, -90.3108], [38.6495, -90.3089]],
|
| 48 |
+
traj_headings=[91.0, 92.5],
|
| 49 |
+
top_k=5,
|
| 50 |
+
)
|
| 51 |
+
print(result)
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
## Citation
|
| 57 |
+
|
| 58 |
+
If you find TrajLoc or the SeqGeo-VL dataset useful in your research, please cite our paper:
|
| 59 |
+
|
| 60 |
+
```bibtex
|
| 61 |
+
@inproceedings{gao2026trajloc,
|
| 62 |
+
title = {Trajectory-aware Cross-view Geo-localization with Sequential Observations},
|
| 63 |
+
author = {Gao, Tianyi and Lin, Jiayu and Beaulieu, Danielle and Jacobs, Nathan},
|
| 64 |
+
booktitle = {European Conference on Computer Vision},
|
| 65 |
+
year = {2026}
|
| 66 |
+
}
|
| 67 |
+
```
|