Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation
Abstract
TAMP-Nav improves embodied navigation by aligning vision-language models with 2D visual prompting, selective reasoning with compressed memory, and dense policy optimization.
Although Large Vision-Language Models (VLMs) have significantly advanced embodied navigation, their direct deployment remains challenging, as existing methods often force VLMs into unnatural action spaces that misalign with their 2D pre-training priors, compounded by rigid reasoning schedules and inefficient memory management. To overcome these limitations, we propose TAMP-Nav, a unified framework for efficient embodied navigation. First, we introduce a Pixel-to-3D Action Formulation (Point) that reformulates navigation into 2D visual prompting. Specifically, the VLM merely selects 2D pixels, which are then projected into 3D coordinates for a low-level SLAM controller. This design naturally aligns embodied execution with the VLM's inherent 2D visual capabilities. Second, we propose an integrated Selective Reasoning and Anchor-Trajectory Memory mechanism (Think and Memorize), which dynamically triggers Chain-of-Thought and retains high-fidelity memory only at critical nodes, compressing redundant trajectories into lightweight Space-Time Indicators, thereby preserving critical historical information and enhancing spatio-temporal perception. Finally, we design an efficient Two-Level Alignment Paradigm (Align) via Group Relative Policy Optimization (GRPO). By superimposing global outcome rewards with fine-grained process rewards, this dense supervision tightly aligns the agent's cognitive planning with physical environmental feedback, endowing the model with adaptive reasoning capabilities. Experiments demonstrate that TAMP-Nav achieves state-of-the-art performance (e.g., 66.2% SR on R2R-CE) with high runtime and sample efficiency (requiring only 90k training trajectories).
Community
Efficient embodied navigation requires more than accurate action selection: an agent must also know when to reason, what to remember, and how to learn from environmental feedback. We introduce TAMP-Nav, where the model selects target points directly in images and projects them into 3D coordinates for execution by a SLAM system. It triggers Chain-of-Thought only at critical decision points, while Anchor-Trajectory Memory preserves important states and compresses routine paths. Two-Level GRPO further combines step-level feedback with trajectory-level outcomes to jointly optimize action selection and selective reasoning. Trained on only 90k trajectories, TAMP-Nav achieves success rates of 66.2% on R2R-CE and 65.7% on RxR-CE while reducing CoT calls by 73.7%. The resulting policy transfers zero-shot to real-world indoor and outdoor environments without real-robot fine-tuning.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- SAGE-Nav: Leveraging LLM Planning and Alignment Fusion for Hierarchical Scene Graph-Guided Navigation (2026)
- MemVLN: Episodic and Procedural Memory for Vision-and-Language Navigation (2026)
- FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation (2026)
- ABot-N1: Toward a General Visual Language Navigation Foundation Model (2026)
- LocalNav: Distilling Frontier VLMs and Embodied RL for On-Device Object Goal Navigation (2026)
- VTInstructor: Visual Trajectory Prompting for Navigation Instruction Generation in Continuous Environments (2026)
- Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2608.17512 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper