paper-with-me

Papers

One-4-All: Neural Potential Fields for Embodied Navigation

2023-03-07 · Sacha Morin, Miguel Saavedra-Ruiz, Liam Paull

A fundamental task in robotics is to navigate between two locations. In particular, real-world navigation can require long-horizon planning using high-dimensional RGB images, which poses a substantial challenge for end-to-end learning-based approaches. Current semi-parametric methods instead achieve long-horizon navigation by combining learned modules with a topological memory of the environment, often represented as a graph over previously collected images. However, using these graphs in practice requires tuning a number of pruning heuristics. These heuristics are necessary to avoid spurious edges, limit runtime memory usage and maintain reasonably fast graph queries in large environments. In this work, we present One-4-All (O4A), a method leveraging self-supervised and manifold learning to obtain a graph-free, end-to-end navigation pipeline in which the goal is specified as an image. Navigation is achieved by greedily minimizing a potential function defined continuously over image embeddings. Our system is trained offline on non-expert exploration sequences of RGB data and controls, and does not require any depth or pose measurements. We show that O4A can reach long-range goals in 8 simulated Gibson indoor environments and that resulting embeddings are topologically similar to ground truth maps, even if no pose is observed. We further demonstrate successful real-world navigation using a Jackal UGV platform.

📄 PDF Abstract BibTeX arXiv:2303.04011

Code (1)

montrealrobotics/one4all pytorch

Tasks

AllNavigate

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Towards Learning a Generalist Model for Embodied Navigation

2023-12-04 · CVPR 2024 1 · Duo Zheng, Shijia Huang, Lin Zhao, Yiwu Zhong 외

Building a generalist agent that can interact with the world is the intriguing target of AI systems, thus spurring the research for embodied navigation, where an agent is required to navigate according to instructions or…

3D Question Answering (3D-QA)Embodied Question AnsweringNavigateQuestion Answering+1

g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Tasks

2024-11-26 · CVPR 2025 1 · Zihan Wang, Gim Hee Lee

We introduce Generalizable 3D-Language Feature Fields (g3D-LF), a 3D representation model pre-trained on large-scale 3D-language dataset for embodied tasks. Our g3D-LF processes posed RGB-D images from agents to encode f…

Contrastive LearningQuestion AnsweringVision and Language Navigation

Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigation

2022-06-12 · Chengyang Ying, You Qiaoben, Xinning Zhou, Hang Su 외

Embodied agents in vision navigation coupled with deep neural networks have attracted increasing attention. However, deep neural networks have been shown vulnerable to malicious adversarial noises, which may potentially …

Safety of Embodied Navigation: A Survey

2025-08-07 · Zixia Wang, Jia Hu, Ronghui Mu arxiv

As large language models (LLMs) continue to advance and gain influence, the development of embodied AI has accelerated, drawing significant attention, particularly in navigation scenarios. Embodied navigation requires an…

CoNav: Collaborative Cross-Modal Reasoning for Embodied Navigation

2025-05-22 · Haihong Hao, Mingfei Han, Changlin Li, Zhihui Li 외

Embodied navigation demands comprehensive scene understanding and precise spatial reasoning. While image-text models excel at interpreting pixel-level color and lighting cues, 3D-text models capture volumetric structure …

Scene UnderstandingSpatial Reasoning