paper-with-me

홈 › Papers

Active Domain-Invariant Self-Localization Using Ego-Centric and World-Centric Maps

2022-04-22 · Kanya Kurauchi, Kanji Tanaka, Ryogo Yamamoto, Mitsuki Yoshida

The training of a next-best-view (NBV) planner for visual place recognition (VPR) is a fundamentally important task in autonomous robot navigation, for which a typical approach is the use of visual experiences that are collected in the target domain as training data. However, the collection of a wide variety of visual experiences in everyday navigation is costly and prohibitive for real-time robotic applications. We address this issue by employing a novel {\it domain-invariant} NBV planner. A standard VPR subsystem based on a convolutional neural network (CNN) is assumed to be available, and its domain-invariant state recognition ability is proposed to be transferred to train the domain-invariant NBV planner. Specifically, we divide the visual cues that are available from the CNN model into two types: the output layer cue (OLC) and intermediate layer cue (ILC). The OLC is available at the output layer of the CNN model and aims to estimate the state of the robot (e.g., the robot viewpoint) with respect to the world-centric view coordinate system. The ILC is available within the middle layers of the CNN model as a high-level description of the visual content (e.g., a saliency image) with respect to the ego-centric view. In our framework, the ILC and OLC are mapped to a state vector and subsequently used to train a multiview NBV planner via deep reinforcement learning. Experiments using the public NCLT dataset validate the effectiveness of the proposed method.

📄 PDF Abstract BibTeX arXiv:2204.10497

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningRobot NavigationVisual Place Recognition

Similar Papers 제목 키워드 기반

Domain-invariant NBV Planner for Active Cross-domain Self-localization

2021-02-23 · Kanji Tanaka

Pole-like landmark has received increasing attention as a domain-invariant visual cue for visual robot self-localization across domains (e.g., seasons, times of day, weathers). However, self-localization using pole-like …

Deep Reinforcement Learning

Deep SIMBAD: Active Landmark-based Self-localization Using Ranking -based Scene Descriptor

2021-09-06 · Tanaka Kanji

Landmark-based robot self-localization has recently garnered interest as a highly-compressive domain-invariant approach for performing visual place recognition (VPR) across domains (e.g., time of day, weather, and season…

Q-LearningReinforcement Learning (RL)Transfer LearningVisual Place Recognition

Active Semantic Localization with Graph Neural Embedding

2023-05-10 · Mitsuki Yoshida, Kanji Tanaka, Ryogo Yamamoto, Daiki Iwata

Semantic localization, i.e., robot self-localization with semantic image modality, is critical in recently emerging embodied AI applications (e.g., point-goal navigation, object-goal navigation, vision language navigatio…

CPUDomain AdaptationGraph Neural NetworkSelf-Supervised Learning+2

Retrieval-based Localization Based on Domain-invariant Feature Learning under Changing Environments

2019-09-23 · Hanjiang Hu, Hesheng Wang, Zhe Liu, Chenguang Yang 외

Visual localization is a crucial problem in mobile robotics and autonomous driving. One solution is to retrieve images with known pose from a database for the localization of query images. However, in environments with d…

Autonomous DrivingRetrievalTranslationVisual Localization

Long-Term Invariant Local Features via Implicit Cross-Domain Correspondences

2023-11-06 · Zador Pataki, Mohammad Altillawi, Menelaos Kanakis, Rémi Pautrat 외

Modern learning-based visual feature extraction networks perform well in intra-domain localization, however, their performance significantly declines when image pairs are captured across long-term visual domain variation…

Visual Localization