BEyond observation: an approach for ObjectNav
With the rise of automation, unmanned vehicles became a hot topic both as commercial products and as a scientific research topic. It composes a multi-disciplinary field of robotics that encompasses embedded systems, control theory, path planning, Simultaneous Localization and Mapping (SLAM), scene reconstruction, and pattern recognition. In this work, we present our exploratory research of how sensor data fusion and state-of-the-art machine learning algorithms can perform the Embodied Artificial Intelligence (E-AI) task called Visual Semantic Navigation. This task, a.k.a Object-Goal Navigation (ObjectNav) consists of autonomous navigation using egocentric visual observations to reach an object belonging to the target semantic class without prior knowledge of the environment. Our method reached fourth place on the Habitat Challenge 2021 ObjectNav on the Minival phase and the Test-Standard Phase.
Code (1)
Tasks
Autonomous NavigationObjectSimultaneous Localization and MappingSimilar Papers 제목 키워드 기반
3D-Aware Object Goal Navigation via Simultaneous Exploration and Identification
Object goal navigation (ObjectNav) in unseen environments is a fundamental task for Embodied AI. Agents in existing works learn ObjectNav policies based on 2D maps, scene graphs, or image sequences. Considering this task…
Auxiliary Tasks and Exploration Enable ObjectNav
ObjectGoal Navigation (ObjectNav) is an embodied task wherein agents are to navigate to an object instance in an unseen environment. Prior works have shown that end-to-end ObjectNav agents that use vanilla visual and rec…
Auxiliary LearningNavigateObjectGoal NavigationRobot NavigationTrajRAG: Retrieving Geometric-Semantic Experience for Zero-Shot Object Navigation
Existing zero-shot Object Goal Navigation (ObjectNav) methods often exploit commonsense knowledge from large language or vision-language models to guide navigation. However, such knowledge arises from internet-scale text…
Spatial-Semantic Reasoning using Large Language Models for Efficient UAV Search Operations
We present a real-time semantic navigation framework for Unmanned Aerial Vehicles (UAVs) focused on improving time efficiency in the Object Goal Navigation (ObjectNav) task. Central to our approach is a Large Language Mo…
Real-Time Object DetectionTrajectory PlanningTHDA: Treasure Hunt Data Augmentation for Semantic Navigation
Can general-purpose neural models learn to navigate? For PointGoal navigation (""go to x, y""), the answer is a clear `yes' -- mapless neural models composed of task-agnostic components (CNNs and RNNs) trained with l…
Data AugmentationNavigateObjectGoal NavigationOpen-Ended Question Answering+1