Skip to content
AI News HubLIVE
Original source2 min read

A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation

Summary

This survey systematically reviews the state of the art in embodied Vision-and-Language Navigation (VLN), organizing methods along two orthogonal dimensions: action paradigms (hierarchical vs. monolithic) and model paradigms (discriminative vs. generative). The authors conduct a real-world evaluation on a physical robotic platform across ten diverse scenes, revealing a significant simulation-to-real gap: a monolithic RGB-only method achieves 61% success in simulation but drops to 22% in the real world, while a hierarchical framework attains 51% real-world success. Key challenges in perception, decision-making, and control are highlighted.

SourcearXiv RoboticsAuthor: Liuyi Wang, Kai Sheng, Zongtao He, Jinlong Li, Yongrui Qin, Haojie Dai, Xiangyi Wang, Jingwei Yang, Qingqing Yan, Chengju Liu, Qijun Chen
A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 9 Jul 2026]

Title:A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation

View a PDF of the paper titled A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation, by Liuyi Wang and 10 other authors

View PDF HTML (experimental)

Abstract:Navigation is a fundamental capability of autonomous systems, yet most existing approaches rely on highly structured models and strong prior assumptions, limiting their robustness in open and uncertain real-world environments. Vision-and-Language Navigation (VLN) offers a promising direction by enabling robots to integrate natural language understanding with visual perception in a data-driven manner. Although VLN has attracted increasing research attention, systematic methodological taxonomy and real-world validation remain limited. This survey presents a comprehensive review of VLN research. Specifically, state-of-the-art methods are organized along two orthogonal dimensions: action paradigms, including hierarchical and monolithic frameworks, and model paradigms, including discriminative and generative approaches. A critical analysis of their respective strengths and limitations is provided. Additionally, we conduct a systematic real-world evaluation of representative VLN system configurations on a physical robotic platform. Experiments across ten diverse real-world scenes show a substantial performance gap between simulation and real-world deployment under the tested configurations: a representative monolithic RGB-only method achieves 61% success in simulation but drops to 22% in real-world deployment, while a hierarchical framework achieves a higher real-world success rate of 51%, suggesting stronger robustness in our evaluation setting. Finally, we highlight key challenges in perception, decision-making, and control that must be addressed in future research.

Comments: This paper has been accepted by IEEE TASE 2026

Subjects:

Robotics (cs.RO); Artificial Intelligence (cs.AI)

Cite as: arXiv:2607.09792 [cs.RO]

(or arXiv:2607.09792v1 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2607.09792

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Liuyi Wang [view email] [v1] Thu, 9 Jul 2026 05:13:02 UTC (16,119 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation, by Liuyi Wang and 10 other authors

View PDF

HTML (experimental)

TeX Source

view license

Current browse context:

cs.RO

new | recent | 2026-07

Change to browse by:

cs cs.AI

References & Citations

NASA ADS

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

InvestorsAdvanced

Key points

  • Proposes a two-dimensional taxonomy for VLN methods: action paradigms (hierarchical/monolithic) and model paradigms (discriminative/generative).
  • Systematic real-world evaluation on a physical robot across ten scenes shows substantial sim-to-real gap.
  • Hierarchical framework achieves 51% real-world success rate, outperforming monolithic RGB-only method's 22%.
  • Identifies key challenges in perception, decision-making, and control for future research.

Highlights and analysis are generated automatically and may contain errors. Check the original source.