Other
retrieval
cross-view
geo-localizaiton
research-WM nielsr HF Staff commited on
Commit
3589e02
·
1 Parent(s): 9bd3eef

Add model card and pipeline metadata (#1)

Browse files

- Add model card and pipeline metadata (e415929e40312a89b3c6dfc3a485bc71cf23ecca)


Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +64 -0
README.md CHANGED
@@ -1,3 +1,67 @@
1
  ---
2
  license: mit
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ pipeline_tag: other
4
  ---
5
+
6
+ # TrajLoc: Trajectory-aware Cross-view Geo-localization with Sequential Observations
7
+
8
+ [🏠 Project Page](https://humblegamer.github.io/trajloc/) | [📖 Paper](https://arxiv.org/abs/2607.15491) | [💻 GitHub](https://github.com/mvrl/TrajLoc) | [📊 SeqGeo-VL Dataset](https://huggingface.co/datasets/jiayulin/SeqGeo-VL)
9
+
10
+ This repository contains the pre-trained weights for **TrajLoc**, presented at ECCV 2026.
11
+
12
+ TrajLoc is a unified framework for cross-view geo-localization that localizes a *trajectory* instead of a single ground image. Given a street-view video sequence, a natural-language route description, or both, it retrieves the matching geo-tagged satellite tile.
13
+
14
+ <p align="center">
15
+ <img src="https://raw.githubusercontent.com/mvrl/TrajLoc/main/assets/teaser.png" width="85%" alt="TrajLoc concept teaser"/>
16
+ </p>
17
+
18
+ ## Highlights
19
+ - **Unified Multi-modal Query**: Supports querying with video frames, plain-language route descriptions, or a blend of both.
20
+ - **Spatially-grounded Embeddings**: Integrates **TrajMod**, a lightweight module that maps route geometry to modulate query embeddings for spatially-aware representations.
21
+ - **Agentic Tool Interface**: Includes a function-calling tool interface so multimodal agents can easily localize routes as part of broader spatial reasoning.
22
+
23
+ ---
24
+
25
+ ## Quickstart & Usage
26
+
27
+ Please refer to the official [TrajLoc GitHub repository](https://github.com/mvrl/TrajLoc) for installation instructions and dependencies.
28
+
29
+ ### Python API Example
30
+
31
+ You can use the model as a tool for trajectory localization:
32
+
33
+ ```python
34
+ from trajloc_tool import TrajLocTool
35
+
36
+ # Initialize the tool with the pretrained checkpoint
37
+ tool = TrajLocTool(
38
+ checkpoint_path="checkpoints/trajloc_full.pth",
39
+ gallery_manifest="gallery.json", # satellite tiles to search over
40
+ gallery_cache="gallery_features.pt", # features cached here after the first run
41
+ )
42
+
43
+ # Localize a trajectory using a text-based route description
44
+ result = tool.localize_trajectory(
45
+ query_mode="text",
46
+ text="The route heads east along a tree-lined street, then turns right at the church.",
47
+ traj_coords=[[38.6488, -90.3108], [38.6495, -90.3089]],
48
+ traj_headings=[91.0, 92.5],
49
+ top_k=5,
50
+ )
51
+ print(result)
52
+ ```
53
+
54
+ ---
55
+
56
+ ## Citation
57
+
58
+ If you find TrajLoc or the SeqGeo-VL dataset useful in your research, please cite our paper:
59
+
60
+ ```bibtex
61
+ @inproceedings{gao2026trajloc,
62
+ title = {Trajectory-aware Cross-view Geo-localization with Sequential Observations},
63
+ author = {Gao, Tianyi and Lin, Jiayu and Beaulieu, Danielle and Jacobs, Nathan},
64
+ booktitle = {European Conference on Computer Vision},
65
+ year = {2026}
66
+ }
67
+ ```