paper-with-me

Papers

Vision-Language Navigation with Embodied Intelligence: A Survey

2024-02-22 · Peng Gao, Peng Wang, Feng Gao, Fei Wang, Ruyue Yuan

As a long-term vision in the field of artificial intelligence, the core goal of embodied intelligence is to improve the perception, understanding, and interaction capabilities of agents and the environment. Vision-language navigation (VLN), as a critical research path to achieve embodied intelligence, focuses on exploring how agents use natural language to communicate effectively with humans, receive and understand instructions, and ultimately rely on visual information to achieve accurate navigation. VLN integrates artificial intelligence, natural language processing, computer vision, and robotics. This field faces technical challenges but shows potential for application such as human-computer interaction. However, due to the complex process involved from language understanding to action execution, VLN faces the problem of aligning visual information and language instructions, improving generalization ability, and many other challenges. This survey systematically reviews the research progress of VLN and details the research direction of VLN with embodied intelligence. After a detailed summary of its system architecture and research based on methods and commonly used benchmark datasets, we comprehensively analyze the problems and challenges faced by current research and explore the future development direction of this field, aiming to provide a practical reference for researchers.

📄 PDF Abstract BibTeX arXiv:2402.14304

Code (0)

등록된 구현이 없습니다.

Tasks

SurveyVision-Language Navigation

Similar Papers 제목 키워드 기반

Advances in Embodied Navigation Using Large Language Models: A Survey

2023-11-01 · Jinzhou Lin, Han Gao, Xuxiang Feng, Rongtao Xu 외

In recent years, the rapid advancement of Large Language Models (LLMs) such as the Generative Pre-trained Transformer (GPT) has attracted increasing attention due to their potential in a variety of practical applications…

Decision Making

A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science

2025-04-14 · Jie Feng, Jinwei Zeng, Qingyue Long, Hongyi Chen 외

Over the past year, the development of large language models (LLMs) has brought spatial intelligence into focus, with much attention on vision-based embodied intelligence. However, spatial intelligence spans a broader ra…

Language ModelingLanguage ModellingLarge Language ModelSpatial Reasoning

Deep Learning for Embodied Vision Navigation: A Survey

2021-07-07 · Fengda Zhu, Yi Zhu, Vincent CS Lee, Xiaodan Liang 외

"Embodied visual navigation" problem requires an agent to navigate in a 3D environment mainly rely on its first-person observation. This problem has attracted rising attention in recent years due to its wide application …

Autonomous DrivingDeep LearningNavigateSurvey+1

Core Challenges in Embodied Vision-Language Planning

2021-06-26 · Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu 외

Recent advances in the areas of multimodal machine learning and artificial intelligence (AI) have led to the development of challenging tasks at the intersection of Computer Vision, Natural Language Processing, and Embod…

Survey

Sensing, Social, and Motion Intelligence in Embodied Navigation: A Comprehensive Survey

2025-08-21 · Chaoran Xiong, Yulong Huang, Fangwen Yu, Changhao Chen 외 arxiv

Embodied navigation (EN) advances traditional navigation by enabling robots to perform complex egocentric tasks through sensing, social, and motion intelligence. In contrast to classic methodologies that rely on explicit…