dourakushinju commited on
Commit
9b37f0d
Β·
verified Β·
1 Parent(s): 54a8fba

Update model card for GN0 companion model

Browse files
Files changed (1) hide show
  1. README.md +110 -0
README.md CHANGED
@@ -1,3 +1,113 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ tags:
4
+ - vision-language-navigation
5
+ - embodied-ai
6
+ - 3d-gaussian-splatting
7
+ - navigation
8
+ - gn0
9
+ - gn-bench
10
+ - bae
11
+ pipeline_tag: robotics
12
  ---
13
+
14
+ # GN-BAE
15
+
16
+ GN-BAE is the companion navigation policy checkpoint for [GN0](https://github.com/TeleHuman/GN0), a unified research framework for **Generation**, **Evaluation**, and **Policy Learning** in Vision-and-Language Navigation (VLN).
17
+
18
+ GN0 builds on 3D Gaussian Splatting (3DGS) to connect realistic scene construction, high-fidelity embodied simulation, and navigation policy evaluation in visually grounded indoor environments. In the GN0 ecosystem, GN-BAE serves as the navigation foundation model for map-based and map-free policy learning.
19
+
20
+ ## Intended Use
21
+
22
+ This model is intended for research on embodied AI and Vision-and-Language Navigation, especially evaluation with the GN0 / GN-Bench workflow.
23
+
24
+ Use this checkpoint with the GN0 codebase:
25
+
26
+ - Code: https://github.com/TeleHuman/GN0
27
+ - Project page: https://telehuman-gn0.github.io/
28
+ - Paper: https://arxiv.org/abs/2606.03682
29
+
30
+ ## GN0 Context
31
+
32
+ GN0 consists of three connected components:
33
+
34
+ | Component | Description |
35
+ | --- | --- |
36
+ | GN-Matrix | Large-scale 3DGS navigation data with dynamic human avatars. |
37
+ | GN-Bench | Interactive benchmark and simulator for high-fidelity VLN evaluation. |
38
+ | GN-BAE | Navigation foundation model for map-based and map-free policy learning. |
39
+
40
+ This repository hosts the GN-BAE checkpoint referenced by the GN0 model zoo.
41
+
42
+ ## Usage
43
+
44
+ Please follow the installation and evaluation instructions in the GN0 repository.
45
+
46
+ A typical GN0 workspace places this checkpoint under `model_zoo/bae`:
47
+
48
+ ```text
49
+ GN0
50
+ β”œβ”€β”€ data
51
+ β”‚ β”œβ”€β”€ datasets
52
+ β”‚ β”‚ └── GN_Matrix
53
+ β”‚ β”‚ └── InteriorGS_episode
54
+ β”‚ └── scene_datasets
55
+ β”‚ └── InteriorGS
56
+ β”œβ”€β”€ GN-Bench-Tools
57
+ β”œβ”€β”€ model_zoo
58
+ β”‚ └── bae
59
+ β”œβ”€β”€ VLN_CE
60
+ β”œβ”€β”€ run.py
61
+ └── eval_bae_InteriorGS.sh
62
+ ```
63
+
64
+ Example InteriorGS evaluation command:
65
+
66
+ ```bash
67
+ zsh eval_bae_InteriorGS.sh \
68
+ --model-path model_zoo/bae \
69
+ --chunks 1 \
70
+ --procs-per-gpu 1 \
71
+ --save-path tmp/bae_eval
72
+ ```
73
+
74
+ Monitor evaluation progress:
75
+
76
+ ```bash
77
+ watch -n 1 python analyze_results.py --path tmp/bae_eval
78
+ ```
79
+
80
+ ## Evaluation
81
+
82
+ GN0 reports standard VLN metrics from JSON evaluation logs:
83
+
84
+ | Metric | Meaning |
85
+ | --- | --- |
86
+ | TL | Average trajectory length |
87
+ | NE ↓ | Navigation error |
88
+ | OS ↑ | Oracle success |
89
+ | SR ↑ | Success rate |
90
+ | SPL ↑ | Success weighted by path length |
91
+
92
+ Please refer to the GN0 repository for dataset preparation, simulator setup, and full evaluation details.
93
+
94
+ ## License
95
+
96
+ This model is released under the Creative Commons Attribution-NonCommercial 4.0 International license (CC BY-NC 4.0).
97
+
98
+ ## Citation
99
+
100
+ If GN0, GN-Bench, or this model is useful for your research, please cite:
101
+
102
+ ```bibtex
103
+ @article{li2026gn0,
104
+ title={GN0: Toward a Unified Paradigm for Generation, Evaluation, and Policy Learning in Visual-Language Navigation},
105
+ author={Li, Xinhai and Zhang, Xiaotao and Huang, Yuehao and Dong, Jiankun and Wang, Tianhang and Zhou, Sunyao and Wu, Yunzi and Sun, Chengnuo and Ge, Yunfei and Weng, Qizhen and Zhang, Chi and Bai, Chenjia and Li, Xuelong},
106
+ journal={arXiv preprint arXiv:2606.03682},
107
+ year={2026}
108
+ }
109
+ ```
110
+
111
+ ## Acknowledgements
112
+
113
+ GN-Bench-Tools is adapted from Habitat-Lab and customized for 3D Gaussian Splatting-based navigation. We thank the Habitat-Lab developers, the InteriorGS authors, and the broader Embodied AI and 3DGS open-source communities.